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'ABSTRACT 

Sunaarized in^the first part of tie . report are the 
'dfeiiberations of the Southern Regional Education Board's Task Force 
on 'Faculty Evaluation and Institutional Reward" Structures during 
j?t6r77.. The group assisted the SREB staff to analyze procedures 
diitrentiy used by instituti*ons to judge faculty effectiveness, drew" 
conclusions, and arrived at a set of 'recbaMendations ^ddrfssed to^ 
institutions willing to consider changing their f valuation syjStess, 
The second part of the report, by «. Edaund Mocnaw, review^ t3le 
results of a studjt, on current faculty evaluation^ practices In the 
southern states. (MS E) ' 
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. JLhe community of scholars vvhich makes up higher education 
ccpnsists .primarily jOf students who seek knowledge and teachers who 
/i'mp'aurt 'knowledge, and it may he assumed that good teachers are an 

essientiai'ihgredient for producing good students. 

' ^ SREB research !has indicated that faculty evaluation programs of 
jSoiithern. collegesi and universities,^ by and large, are conducted to 
Jmprove the ef fectivenes^^of "their fakilties. It has also shown, however, 
'ffia evaluation programs emphasize decision making about 

re^ntion, tenare, advancement and termination of staff, while largely 
neglecting the .^videly espoused formative or developmental ^objectives 
aimed at improvement of faculty effectiveness. 

This publication reviews recent S^REB studies which document these 
_;and related conclusions and looks t&ward institutional and regional 
programs which can. be organized for contributing to the resolution of 
the apparent contrast in objectives and outcomes of faculty evaluation. 
In a wor.d, the Board is concerned that faculty evaluation at' colleges" 
and universities be organized. and operated for maximum enhancement 
of the student learning environment which faculty can provide. How 
this can be accomplished remains a major problem in the path toward 
quality education.. 

This report presents the initial conclusions. of a Task Force on 
Facultj^ Evaluation and Institutional Reward Structures convened as 
part of SREB's Undergraduate Education Reform project and a 
summary of SREB's latest research efforts in this area. It is published 
with joint support from the Carnegie Corpora^tion and the Fund for the 
Improvement of Postsecondary Education, in connection with a 
two-year SREB effort for "improving programs, personnel and 
instruction through systematic faculty evaluation" in the region, 
beginning in 1977. 
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A Regional Review ^ 
of Fa culty Evaluation 

E 

JL-^valuating faculty performance for purposes of promotion, 
tenure and salary increases is of singular importance today because of 
leveling and declining student enrollments, lack of faculty mobility and 
increasing financial pressures on institutions. It is vital* that evaluation 
procedures be suitable for helping faculty improve their perfonrance 
and that the relationship between facult\ evaluation and development, 
institutional goals and the institutional row ai'd structure be recognized. 

As parjt^f the SREB Undergi'aduate Education Reform Project, 
which }^ supported by a grant from the Carnegie Corporation, a Task 
Force was formed to* consider ways for institutions lo improve their 
evaluation of faculty in order to assist faculty enhance the quality of 
their vvork. These seven persons, who have agreed to work together over 
a three-year period, represent public and private higher education and 
several types of institutions. 

As a starting point, this gi'oup spent its first > ear assisting the SREB 
staff analyze procedures used by institutions to judge faculty 
effectiveness, drawing conclusions about those procedures aid arriving 
at -a set of recommendations addressed to histitutions willing to 
consider changing their evaluation systems. 

What follows is a summary of the deliberations of the SREB Task 
Force on Faculty Evaluation and Institutional Reward Structures 
during 1976-77. 



Rationale for Evaluation 



The desire to achieve equity -n making administrative decisions about 
faculty has been a major stimulus for increased faculty assessment 
activities in U.S. colleges and universities in the 1970's. An examination 
of the assessment instrument's aiicT procedures, sometines quite 
elaborate, which are used by some institutions indicate:, progress 
toward attain inp this goal. 



1 



Equal progress toward assessing individual faculty contributions ^n 
improving the quality of student intellectual and moral growth has not 
been achieved, however. Yet improvement in the quality of the college 
^ expeiience, and hence improvement in the quality of life generally, may 
bfe the chief challen^te and opportunity facing the Americanlnstitution 
pf higher learning in the remainder of this century. Institutions must 
find a relfable way to assess faculty contributions to student grov;thjn 
knowledge, basic skills, depth of understanding, discriminating ability, 
motivation, expanding interests and breadth of awareness if the 
undergraduate years are to be truly adventures of the mind for most 
students. Such student growth is facilitated by the continuing coucem 
and growing ability of the faculty to stimulate and assist in this 
expanded intellectual development. Current faculty assessment efforts 
do not seem to be designed, or used, to provide an effectivie means of 
faculty self-assessment and/or self-improvement in trying to meet this 
enormous challongt, yex faculty competence seems to have a significant, 
impact o^k student achievement 

Efforts to assess faculty achievements in rq^earch and in 
contributions to institutional and community improvement seem more 
nearly adequate, although institutional, approaches to evaluatinjrthe 
quality and significance of research may not^be completely satisfacioiy. 
It is clear that the quality of life has been" and will continue to be 
positively affected by the contributions to applied research which 
universities have made. Two of the big Chalh?nges to future university 
research are ways to prbtect and improve the environment and 
acceptable ways to meet the energy ' needs of a sophisticated 
techn^^logical society. Therefoie, universities must continue to promote 
and to assess continual improvement in research and the dissemination 
of its results, , 

The expansion of commur^ity colleges has greatly enlarged the scope 
of public service contributions which institutions of higher education 
are able to make, however, assessmentiand development cf faculty 
efforts may need further i^efinement to permit meaningful evaluation of 
this aspect of institutional responsibility. 

In summary, the mam purposes of a faculty Evaluation program are 
to make possible equitable administrative deci&ions affecting faculty 
status, to assure growth in the ability of. the faculty to contribute to the 
intellectual, aesthetic and moral achievement of students (and hence to 
improvement in the quality of life), to promote expansion of the scope 
and quality of basic and applied faculty rese^**ch, and to keep alive a 
sensitivity to the needs of the local, state, and national cornmuQity, A 
good faculty evaluation and development program, in other wordl?>.can 
help a l:ollege or a university to remain dynamic and useful to the 
society of which it is a part. 
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Conclusions about Evaluation 

Baspd on a review of truj information collected and analyzed i)y 
SREB, ^ well as their own collective experiences in the area of ^ ^ ^ 

evaluation, the- Task Force roombers reached a number of conclusions * 
"about the current' state of faculty evaluation in the Southern' region. 

In develop*ffig and operating any system of evaluation, astute and ^ 
sensitivo leadership is an essential ingredient. The appropriate leadership 
can come from administrative ranks or from faculty ranks, hut it is 
most .desirable that it develop in both areas, hi addition to oTihancing 
the quality of leadership, involvnig general faculty early in the 
development of a program and often in its operation makes a system 
, for evaluating faculty stronger and mor^ acceptal)le participants. 

For any program' to be successful, the purposes for which it is - 
established" and o})erated must lie clearly and publicly stated. This 
pnnciplc especially appli*»s to faculty evaluation programs. Institutions 
enter into-t^valuation program^ for a variety of purposes, afthOugh they 
usually foem to be initiated in response to some specific need that has 
arisen. All too often the impetus for the, system is not clearly 
recognized or articulated, and fretiuently the real reasons for ovaliuUion 
are hidden imdcr other publicly announced 4)uxposes. Seldom do 
institutions klentify broader and loiig-range purpo.ses for rsttiljlishinu an 
^evaluation pro.tdure. Program> ntn\ in operation si rve varied and 
sometimes multiple purposes which nuiude. making deci.sions ai out 
salary, promotion and tenure of faculty , inslrLK tional dexelopmVnt and 
improvement: and iiistitut onal de\elopment, pre^umabl> through the 
collective improvement of the facuKy. 

hi relation to stated objectives for evaluation *and desirai)le goals for * , 
such prO^'aifts, several general deficit' ncu's have l)etMi bb^ervi'd by the 
Task P'orce, Two areas of faculty work winch art' uenerally regarded as 
important to the institution are given low status and little emphasis m 
most faculty evaluation program^ academic ad\Ksingand pui)hc servic r. 
Likewise, no evaluation pro^ani fxamined indicates the existence of .. ' 
.specific approaclu*s for judging tht* administrative and mstitutionai 
seivice^. activities whic!^ make up a large portion of the jol) of many 
faculty niemlxMs. And most striking, it also has i)een noted that faculty 
evaluation programs gt*nerall> u.,e tt thniqut's witii no demonstrated » 
validity for mea.suring progie.ss ami .success m the area of .sludent 
learning, even though the area of instruction is reporlt d to i)e of highest . 
priority for evaluation. 

One of the greatest problems ni establishing, operating, and cspcciall) 
describing Tor others, a piomain of ev.ilu.ition relates language. The 



most commonly used terms raising semantic problems are: a) compre- 
hensive, b) equitable, c) syrtematic evaluation -subjective hnd.objective, 
'd) summative andTormativc evaluation, e) assessment, f) measur'^ment, 
and faculty development. These terms are frequently found to be 
included in functioning programs and too ofler seem tojiave special 
definitions m particular settings'. . 

An evaluation system must be designed to suit the particular 
^stitutipn in which it will function.. In other words, it should bo, 
lailor-made for the institution by tho^c who will be involved in it. One 
institution^ cannot a4opt a system from another institOtion, although* 
some -successfiii components mighr be appropriately 'adaptedMf. they , 
relate to the purpyses and desired outcomes of institutional 
program. One of the chief reasoi;^^ a system cannot be transferred from 
one institution to another, aside frpm the fact that it may not be 
feasible to do so,. is that no system* remains static 2,nce designee! and 
approved, but continues to evolve to suit changing needs and times. 
This is a desirable condition and should be both expected and 
encouraged. , v 

One of the reason's for greater attention to the ways in which faculty 
are evaluated is the" desirability for more open approaches that are - 
clearly fair to all involved. Programs vary greatly in tbe exlent to which 
procedures, criteria, and standards arc ^made explicit for all of the 
various areas being judged. For some areas there is -a great deal of^^ 
information about how data are to be collected, aboUt what is to be 
.^considered, and who will be involved in judging. For ether areas in the 
same system, frequently little or no information is provided, indicating 
' the^need for equal explicitness acrqss ail areas to he evaluated. 
However, jn examining the need for spelling out what is to he judged 
and by whom, institutions should be awaie that there is a tendency to 
^ place j[?reat emphasis on examining qUu Mty items when there should be 
* equal emphasis on examining indicators ol qiuility. 

In reviewing currently operating evalujition programs, it is clear that 
th^vjnost organi/cd place a greater emphasis on procedures than on 
other eloment.s of "the'system. This is not surprising since procedur^u 
steps obviously are easier to develop than are clearly delineated apd 
stated purposes, criteria and standards. It is also true that if 
overemphasized, procedures can become so comph?x th^a they may 
subordinate reasons for the system's existence and overshadow other 
elements of the peogram.' 

Not all aspects rf an evaluation system can consist of totally 
objective nieasurem* aI: Biany ispects legitimately rely on subjective^ 
views and professional judgments, ide^y bascJ on specific criteria. 
Systems with componenti> that seemlc^ be working well use a multiple 
set of sources for gathering data to be so judged. 

The Task Force sees little eviderure that institutions have been able to . 
specify the overall value of having an evaluation program, even though 
thero seem to be values whicn can be identified. In spite of the belief of 
many institutions that faculty evaluation programs will stimulate 
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improvement, thm* i,s UiWv or no indication thai th(» data art* so ii>o<l. 
Likewise, no information has hvon foiuu! to indicalr that a sy^uMU of 
evahiation, by stimulaun<i faculty improvcnuMU. will ha.»' a positive 
effect on student jjiowth- :m,implicd assumption (>r many | r^p'ams. 

hi the absence of rosoarch an(J study to indicate specific and 
verifiable outcomes, there is the possibility, hcvwcvcr. that die 
institutional ambiance, or chniate wliuli ma\ emerjie from i 
^•systematic, comprehensive, equitable ' exatuation prt)^rani, u.d even 
from informal understanding.-, about its purposes, cjui lead nuhvidual 
faculty to seek opportunities for er.haiicniii their growth, competence, 
and general wel!-beiii|i. 
- It is clear that in recent years instituticms of hijiher education have 
eiihu-ijed their efforts toward effective faculty evaluation and 
development, but thib area of educational eiidea\or n»;nains a frontier 
inviting more effective exploration and e\permienruion, especially in 
tbe area of jud0H<j init)roved leaclimg and learnings. 



Recommendations 
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* The.SIlKH Task Konc* on fficuhy evaluation, :.ner review of Uie 
" current state of the an of mstUutional evaluaiion of faculty, offers 
several recomniendatu^ns for institutions reaiiy to bemn or revise a 
•system forevaiuatum faculty. 
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The Task Force recommends that: 

r The purposes of a faculty evaluation i)ro^ram be comprehenjiive, 
t learly articuhited and pul)licly stated. 



Faculty members and' adminrstrators be involved in determining 
comprehensive purposes and be committed to using the results of 
evaluation for meeting' all purposes, including those that relate to 
faculty growth and instructional improvement, ^ 
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Procedure's lo be employed in the program's operation be suitable 
t^^y- -^td achieve the stated purposes. 



Faculty members be involved in developing the program and 
continually in its operation and in ways that will stimulate and enhance 
"strong and astute faculty leadershtp. ~ 



The evaluation of faculty be part of a larger system which also focus^^ 
on administrators, chairpersons, and other staff, and be designed to \ 
reflect local circumstances, both inside the institution and in its ^ 
supporting environment. 



The system be designed tu mclude a feedback mechanism for regular 
review through which the system can evolve and improve with 
experience. ' 



Appropriate flexibility be built into the evaluation system, with 
, provisions for differentiated criteria to serve varying professional roles 
of faculty and for differentiated criteria to be^sed in judging varying 



' approaches to instruction. 
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Activity areas such as advising, public and institutional service, 
personal attributes, administrative involvement and others which are 
frequently considered in evaluation, be explicitly identified if they are 
to be included as part of the system. 



A system for evaluation mciudFl)rovision:,^for^'Oltecting data from 
many sources and recommenc^tions from multiple participants, since 
decisions made even in the most carefully conceived systems "of 
evaluation will still largely depend upon a collection of subjective 
judgments. 



Evaluation systems place emphasis on improving ways of assessing 
student learning and growth as a means of determining instructional 
effectiveness. 



Evaluation programs be designed iind data collected which can be used 
»to further faculty growth. 



Section 1 



Currehfr^aculty 
Evaluation Practices 
in tH^Sputh 



pg es and universities evaluate their faculties. They all 
hire, .promote, terminate and, from tim^4o time, provide rewai'ds; 
therefore, they all necessarily make evaluative judgments. At some 
institutions, evaluation procedures are formally established, regularized 
and clearly communicated"^(5' all concerned. At other institutions, 
practices are so informal they are almost indiscernible, even within the 
ihslTtiftions themselves. 

There are increasing institutional concerns about ways to effectively 
judge faculty performance," and there is a need for more information 
and for assistance on this subject. For these reasons, the Southern 
Regipnal Education Board (SREB), over the past several years, has 
studied faculiy evaluation practices in.^ institutions in the 1 1 states it 
serves. The study has had two major components: a sur/ey 
questionnaire directed to all 843 posis^econdary institutions in the 
region in 1975, and a number of irL^dcpth case studies of individual 
faculty evaluation programs during 1976-77. 

Fjrom the survey 536 institutions submitted usable responses to the 
questionnaires, representing an overall response rate of 63.6 percent. 
The response raie ranged fvom 80.5 percent of the doctoral level 
institutions to 58.5 percent of the two-year institutions. The 
questionnaires were completed by institutional administrators, 
primarily academic vice presidents, although presidents and provosts 
also completed a substantial number. ' < 

Institutions were chosen for the in-dejHh case studies on the basis of 
survey responses indicating operation of^ a systematic approach to 
overall faculty evaluation. Case stU(iies were develdped from detailed 
interviews with persons at all levels of the evaluation process- 
presidents, deans, department chairpersons, faculty members, in 
addition to the visits for formal c a.se study, a rumber of more informal 
visits to a variety of institutions were riade to learn about faculty 
evaluation practices. 

These studies have shown thai in the Southern region many 
institutions are making serious efforts to develop sound and systematic 
evaluatipn practices to iussurc fair and appropriate personnel decisions 
and to provide assistance to faculty for development and improvement. 
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*:V.^^. "^^ ^TM study shows that Southern institutions use a gi'eat diversity of 

1^5:. ^ - " approaches to faculty evaluation. It also shows unevenness in' ^he 

'^7 \ ' validity of practices used, in tha effectiveness of some progi^ams in 

fr\ achieving their purposes, and in the consequences various evaluation 

liri, . practices have on institutions using them. 

V- The purpose of this section of the report is to provide an overview of 

Y^' . the* characteristics of faculty evaluation practices in the South by 

Sr.r"~ 'summarizing the results of these. 5^tudies and to discuss observable 

i , conseqirencts oX current-praefciees^ 




Characteristics of Current Practices 



1» Detailed and systematic evaluation practices are most lively to exist 
- in large, doctoral level institutions, 

Detaile^U and systematic procedures which specify criteria and 
standards, use multiple sources of evidence, require examination of 
evidence through institution-wide procedures, and include avenues of 
appeal are most likely to exist at doctoral level institution.^ The 
master's and bachejor's level and two-year colleges generally tend to 
have more informal faculty evaluation procedures, not systematically 
communicated withm the institutions. One reason may 15e~iliaT most 
non-doctoral level institutions . have not felt the same legal 
pressures— institutional or otherwise— which have causec^ the large 
institutions to move toward more formal progi'ams. But pressures for. 
due process and fair and systematic practices seem to be incre<iGing at 
all institutional levels. ^ - 

On the whole, few non-doctoral level institutions seem to liave 
moved toward very formal systematic programs of evaluation. Many 
colleges tend to use fairly informal proc edures which are not very well 
^communicated, probably as a result of the traditions of collegiality 
associated With many ol these institutions. However, qne newer more 
formal approach to a conibiTYation of - -faculty —evaluation and 
developm/Mit is the ''growth contract** being developed primarily at 
private liberal arts collegt with a few examples at community colleges 
and in at U^ast one ('XucrimtMital college which is part of a major public 
uiiiversity. 

Two-year colleges also havf generally miuntained fairly informal 
procedi^res, but a numl:)(»r iu-c^ movii.g towai'd newer types of formal 
system?. Several two-year colleges and one state-wide community 
college system are considering a ''Minagement by Objectives'' approach 
to evaluation and development, while anothei statewide community 
college system is designing a competency-based approach to faculty 
evaluation. 
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2, Faculty evaluation tends most often to bo used as a basis for 
personnel decisions and for managomenl purposes rather than for 
faculty development and improvement. 

Both the survey and the ca.^e studies conducted by SRKB confn-m 
today's widely held belief that faculty evaluation has t^\c) primary 
purposes: providing data with which to make decisions re^'arding 
tenure, promotion, and salary increases; and providing information on 
which faculty -development and improvement ean be based (called - 
**su;nmative^--and *'formati\t " e\aluation, respectively, in much of the 
current Uterature). A majoru> (54 percent) of the total respondents to 
the survey questionnaire stated that the main purpose of faculty 
evaluation is *-lo provide aJjasis for gen^^ral faculty development and 
improvement," Slightly less than a majority (46' percent) reported the 
primary purpose is ''to provide each foculty numloer with diagnostic 
information concerning his instructional i)ehavior and effectiveness." 
Only 36 percent said- their e\aluation procedurt^-^ are used U K^lX-'IlQ-, 
provide information needed in making decisions on salary, promotion 
and tenure." Indeed, -10 percent of the respondento did not rank the 



Table 1 * 

IVrcontajjc of Institutions AfsSij^niiii; First Hank to Kcspcctive 
Ucasons for K\aIuation b\ Institutional i>evd 

>rcenta^eof Institutions Assigning Firs| Rank^ 
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rphjs nnd the ^^th-t ^^^^-j-^^^l^-- this puhh oi.un tir^t app(^fn;d in Boydaiul 
Scbietiniie! ( 197GI 

a\)iuninN mav 'otai more tlian 101) ' IxcaUM' respondents were allowed to assij;n a 
ijixen r.ink to niOM* than oiie < hoice 
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summative purpose as being either first or second in importance. The 
survey results are somewhat different, however, when vievv^ed by 
institutional type, as Table Lshows. 

^'TaBle 1 IHaKes it clear that the administrators who completed the 
questionnaires .considered the summative function of the evaluation 
most important in' the doctoral level institutions, the formative 
function most important in the bachelor's and two-year institutions, 
and a more-or-less even split between the two in the.masten's_ieyel 
institutions. A mere 18 percent of the two-year institutions consider 
Jhe summative purpose most important. 

WHile, a majority of all survey respondents stated that promoting 
faculty development and improvement is tiie primary reason for 
evaluation, few exjfmples of institutions that m fact, use the results of 
evaluation fo»- that purpose could be found in the cases studied or in 
the informal institutional visits. Fewest examples" were found irf the 
bachelor's level and Iwo-year institutions, which claim faculty 
-devd€^^i>t-and Hn^Fovemeftt- -t4^i3-m^n-i^ urpos e o f t tv -evaluation- 
practices^^Of these two types of institutions, two-year institutions are 
more likely to have progi-ams that sepe these purposes than^ are 
bachelor's level institutions. Campus faculty development centers are 
most likely to appear in the dot'toral and master's level institutions, 
where administr^l^oi^ state that the primary purpose of evaluation 
programs is for making personnel decisions. It should be noterf, 
however, that faculty development centers at thpse institutions are not 
part of evaluation programs, and they neither have access to\dala nor 
opportunity to ^ make use of the data that evaluation generates. It 
should be noted also that, while a majority of administrators who 
completed tjie survey questionnaire stated that the primary purpose 
was providing a basis for faculty development and improvement, most 
faculty interviewed in the case studies stated they thought the primary 
purpose was providing data for personnel decisions. These results 
suggest a lack of clarity in evaluation objectives, 

It^eoms clear thai, while many' may think the results of facu^lty- 
evaluation programs should be used as a basis for faculty development 
and improvement, the results a)*e used instead primarily for making 
personnel decisions. Ljitle evidence could bie found that . current 
evaluation practices do promote cjevelopment and improvement or that 
,yiPX include specific procedures likely to have that effect. It is possfble 
thereford to conclude' thaj 'if the primary purpose of current faculty 
evaluation^ practices is to promote faculty development and 
improvement, then that purpose is poorly communicated and seldom 
achieved. While specific procedures for oromoting development and 
improveiii^ftt rarely ejc:ist, procedures for using data for personnel 
decisions are more common. Persons in some institutions believe that 
these summative procedures also often have formative effects. It is 
thought by some, for example, that when faculty become aware that 
certain activities^m* being examined closely for purposes of personnel 
decisions, they try to improve performance in these areas. Some 
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administratorft in doctoral level institutions state they have obsei*ved 
Ttliis^fieno^ in publications^ 

'Some^institutions gather data on faculty performance and simply 
return it directly and solely to the individual faculty members. Little 
evidence could be found, however, thai this practice resulted in 
deMopment and improvement. Through the case studies it was found 
that when this practice was followed, mrely did any discussion 
coricerning the evaluation results take place even among faculty, less 

"^vitlT^dmini§^^^ — — 

.Spmietimes there is difficulty Jn distinguishing clearly between 
^^nVmktive and formative ^ii^uation. Persons active in faculty 
^evelogment use the two terms sepa^atel^^^d usually think af them as 
^J^.ading^o separate acitiv^ *TormativeeVal«ation" ^ considered to 
6e evaluation that^c^n be used' to guide a set of acOyrttes^-sp^cifi^^ 
designed to assist^ a faculty member with development and^ 
!:Kprovemeat. '*Summative evaluation" is thought of as a process which 
can provide information for making person nel decisions unrelated to 
^helping faculty members change or improve. IrTthe instittrtionFstudicc^ 
JhoAyiver.^it wa s clear that this use of these terms is not ^universal. 
Administrators in a number of doctoral and master's le.vel institutions^ 
interpret<the personnel decision making process itself as resulting 
ideally irf\QVbTall ^faculty improyement. One such aShiinistrator stated 
the ov^raH\)bjective of )iis university's evaluation program this way: 
. . to improv^e, the professional competence and performance of the 
tr-faculty -collecUvely. .by^ irxiprovement_in the qualify of individuals 
retained and dismissal of those judged to i)e below tlVe institution's 
standard/*' For this admhiistrator and others, summative and formative 
.^.evaluation are in reality one. A properly administered summative 
- process is thought to improve the overall quality of the total ^acuity by 
Identifying, rewarding and promoting the top performers,' while 
terminating low performei^. This use of the terminology may explain 
why a high number of survey respondents^ stated that their purpose was 
faculty-developpaent and improvement. At any rate, the number of 
institutions witfi formal faculty development programs is much smaller 
than' the nuftiber stating that general faculty development and 
improvement is the main purpose of their faculty evaluation activities. 

The .case studies revealed that faculty evaluation programs also are 
used hy some institutions to serve a management function. At these 
institutions T^ach department's work load is di\^ided among the 
department's faculty at the beginning of each year, and then each 
faculty member's work distribution agreement identifies the evaluation 
arpas and the criteria for his or her Evaluation. Administrators in these 
institutions state that this practice allows them to ensure that all the 
department's responsibilities are covered, that the work load is divided 
equally and fairly, that faculty know clearly what their responsibilities 
are and precisely on what activities they will be judged. This practice 
also seems to provide a degree of iidividualization of faculty 
evaluation. 
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-,:3^J!acuJty evaLiJ^onj)racticesjasi^ are initiated and carried out by 
^-"administratorsrwith^little faculty involvement. * 

Evaluation is by nature a threatening activity, so it should comejas no 
surprise that faculty rarely take the niitiative in organizing faculty 
evaluation programs. But what may be burprisuig ii> that, after programs 
are ^initiated, faculty rarely play a substantiiJ role in the functioning of 

- — a-program, - „ 1 

, The survey results demonstrate conclusively that the academic dean 
and department chairman are the iwo most important officials in any 
faculty development program, whtther for formative or sumniative 
purposes. Table 2 shows tua. * ammative decisions, the academic 
- -dean is the princij^al decision maker in master's, bachelor's and 
two-yQar institutions, and department chairmen are the principal 
decision makers in doctoral^ level institutions. Table 2 shows also that 
faculty members individually, and faculty committees, are more likely 
to participate in the evaluation process in doctoral level institutions 
than elsewhere. However, only 13 percent of the doctoral level 
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Tabic 2 

Assignment of Principal Evaluation Responsibility for Decisions on 
Salary, Promotion and Tenure, by Institutional Type, Percentages 







Percentages Reporting Respective 
Sources as Principal 




'^Responsible Person(s) 


Doctoral* 


Nfaster's 


Bachelo*f^ * 'T.Vip-Year 


Department Chairman 


36.7% 


30.6% 


24 1% 


27.8%- 


Academic Dean or 
Vice President 


30.4 - 


32.0 


"39.6 


35.7- 


Faculty Committee 


13.3 


8.1 


9:3 


1.7 


President^or Provost 


4,4 


7.5 


12.2 


11.7 


Colleagues 


3.3 


2.2 


0.3 


0.0 


Peers (other 
institutions) 


--2.3 


0.0 


0.0 


0.0 


Students 


1.3 


1.9 


1.3 


2.5 


Others* 


0.4 


1 1 


1.2 


0.8 


No Response- » 


^ ^ 8.0 


16.7 


12.0 


20.1 



li^.J^r^ ♦Including alumni^ joint student-tnculty groups, self. 
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institrition<L.assi^ iaculty-committyes a major role. It^as found in the 
'^case ^study. .institutions that faculty are used irPdoctoral level 
instituiions primarily to make judgments on the quality ol research an J 
publications, whicl^ can explain why faculty do not have major^oles 
outside th^j doctoral level institutions. It also is of interest to note in 
J*able 2 thpt stUdents are more likely to be tissigned a major role in the 
^two-year institutions than in others, fndeed, students ai'e assigned a 
,greater role in Xhese institutions than are either individual faculty or 
faciilty-comm^tteec. - 

When -the focus shifts ffom summative to formative evaluation 
' (Table 3), similar results are' shown although faculty committees play 
an even smaller role. The major difference between Table 3 and Table 2 
is that students are assigned a greater role in formative than in ^ 
sUmmgtiye^e^^^^ In other words, stude nt ratings of instruction^re 

used more often for development and improvement than for personnel 
decisions. This may also suggest that student ratings of instruction are 
the only deyelopmental activity taking place at some institutions. 



Table 3 ■ 



Assignment of Principal Evaluation Responsibility for Faculty 
Devclopme~it, by Institutional Type^, Percentages 







Percentages Reporting Respective 
.Sources as Principal 




' Source of Principal 
Responsibility 


Oortocal 


Master *s 


Bachelor's 


Two-Year 


Department Chairman 


35,57. 


36,3% 


26.0% 


30.1% , 


^^cademic Dean or 
Vice President * 


18.7 


25.3 


32.8 


36.9 


Students 


13.9 


9.8 


^ 12.9 


12.5 


Faculty Committee 


5.1 


3.9 


1.8 


0.8 " 


Self 


•1.4 


4.7 


3.4 


3.7 


President or Provost 


•l.O 


1.9 


2.7 


0.6 


Colleagues 


2,0 


2,0 


2.6 


0.6 


Others* 


3.1 


1 3 


1.9 '* ' 


1.4 


No Response 


13.3 


14 8 


16.0 


13.4 ■ 



♦Including alumni, joint student faculty groups, peers from other institutions. 
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"The ovenvhelmlng tmpolrtance of the roles of academic deans and 
department chairmen raises two concerns: (1) Should the faculty itself 
have a gr.eat^r role in the evaluation process? and (2) Are the academic 
deans :and department chairijie.i prepared to carry out this important 
responsibility? The case studies suggest that institutions which assign a 
greater role to facufty in the evaluation process tend to have higher 
faculty liiorale and greater faculty acceptance of evaluation and its 
results than institutions which do not include as much faculty 
participation. A common complaint of top administrators interviewed 
for-the case studies was that department chairmen do not play their 
roles in the evaluation process properly. A^number of academic deans 
and dep^irtment chjiirmen interviewed in the institutions studied 
indicated the need for training, especially in using evaluation for 
developmental purposes. Some deans and chairmen seem to find 
assisting" Individual faculty with development" and improvement a 
difficult and awkward loie for which they have IHtle training, or 
perhaps understanding. While some institutions have developed special 
offices with staffs to serve this role, budget restrictions have prevented 
the establishment of such offices in a large number of institutions. 



4. Administrators say that instruction is the most important evaluation 
area at their institutions, but, in fact, procedures for evaluating 
instruction are gener^ly poorly developed. 

Respondents to the survey were ^ked to indicate th^e relative 
importance of nina evaluation areas in making personnel decisions at 
their institutions. Table 4 shows the results of thi§ ranking process. 
**Instructionjl activities'' (defined as mcluding classroom teaching, 
laboratory suneivision, thesis direction, and co.urse preparation) were 
rartkedihe mostJieavLly weighted, area for overall faculty, evaluation in 
allotypes of msti^utions. Respondents were permitted to assign a given 
rank to more than one area if severaf areas were equally important, and 
some doctoral level institutions ranked instruction equal in importance 
to research and publication. Each category of institutions, taken as a 
group, ranked instruction above everything else, however.'The survey 
results show conclusively that adniinistrators consider instruction the 
most important activity for evaluation in all of the responding 
institutions. 

But while administrators reported in the survey that instruction is 
tht; most important area for fatuity evaluation, it was found in the case 
studies "that procedures for evaluating instruction are not as v#ell 
developed as are procedures in other areas, particularly research and 
A publication. It may be that administrators feel ipstiuctign should be the 
most important area both for faculty activity and for faculty evaluation 
but this attitude has not yet been translated into practice. 
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. , • Table 4 






T 
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, ' Rank Order of Evaluation Areas Considered in Evaluatjlpn 
^ for Advancement, by Type of Institution 






^ ' * Rank Order of Evaluation Areas 






' . ' AH 

- * - Evaluation Institute Doc- Mas- Bache^. Two- 

Area lions toral ter lor's Year 


Below 
5 *000 ^ 


" — -'-f 

Aboy? 

5,o6a^ 






• * ^ 

• u Instructional 

Aqtivities 1 1 1 


1 


1 






^ . Student Advisinj; «^ - 2 I Z 2 

^ ~ Administrative 

Activities 3 " *5 3 4 


2 
2 


-2 

3 


3 • 




* Personal 

Attributes 4 6 5 3 


4 " 


4 


6 ^ 


" - 


Research . ^ 2 4 5 


7 


5 


2 


if.: 


•Publications 6 3 6 6 


9 


7 


5 : 




Activity in Profes- 
sional Societies • ' 6 7 7 6 


5 


6 


7 




- ,^ Public Service ' 8 8 8 8 


8 


9 


7 ] 




Civic Activities 8* 9 9 8*^ 


5 




9 ^ 


f - ; , 












5. Data or evidence on whicli judgments are made, particularly in 
evaluating instruction, are not giithercd systematically or consistently. 
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The survey results demonstrate that not only are administrators the 
main decision makers in current faculty evakration practices, they also 
are the main sources of* information for these evaluations. Table 5 
shoves sources of information for use \n facufty evaluation. Tables 6 and 
7 provide the same information au oru'ng to the purpose of evaluation; 
Table 6 is concerned ^vith summative -evaluation, Table 7 with 
formative evaluation. 

Table 5 shows that ahe three mdst frequently used sources of 
infoi^mation are the academic vice president or dean, the department 
chairman apd students. Department chairmen are the single most 
frequent source of information in doctoral and master's level 
institutions, ai;! i the academic vice presidenLor dean is most often used 
in bachelor's level 'd\ui two-year institutions: Tables 6 and 7 show the 
dominance _ oL-Jhe academk vice president and the dejEiirtment 
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chairman, regardless of the purpose of evaluation. 
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Table 5 




Sources of Information for Overall Use by. Control, Type, and Enrollment » 
Percentage Utilizing; ' 





Control 




Type of Institutio 


n ' 


enrollment 








Doc- 


Mas- 


Bache- 


Two- 


Helow 


i,oob- 


Above 


'^Sourceof Information 


Pubjic 


IVivate 


toral 


ter's 


lor *s 


Year 


1,000 


5,000 


5,000 


^;;Acad<>niic,Di?an or V.P; 


88% 




S-\% 


83rr 


96rr 


93?r 


92% 


02^r 


847o 


,/AiUmni — 

^Colleagues 


13 


21 


20 


18 


4»22 


1 •! 


23 . 


>- 16 




Ab 


•13 




50 


48 


32 


38 


42 


61 


l^rDcpailinOUt Chairman 






93 


92 


92 


87 


78 


95 


100 


^FaJfrty Committee 


37 


43 


60 ' 


58 


41 


17 


38' ^ 


3^1 7 


53^ 


/Joint Committee 
(faculty/student) 


11 


9 


l^ 


7 


10 


9 


8 


10 


15 


jCPeers.(other institutions) 


9 


9 


35 


7 


5 




5 


7 


23 


^President or Provost 


13 


53 


39. 


48 


57 


i 


51 


46 » 


43 


LrSelf-EValuation 


63 


46 


•16 


53 


52 




52 


55 


65 


(Students • 


88 


88 




87 


87 


91 


88 


91 


82 



It soems si^iificant to iiolc as U^oun in Tables 6 and 7 that students 
are used more often a.s sources of information for formative than for 
summativr purposes. Fewer than half of Uu* responding institutions 
report that the\ use information from students for mniking personnel, 
decisions, but 88 per* en t of the respondenii) rep5rt using students as 
sources of information for overall use although we do not kno\y, 
precisely how their opinions are used or to what extent they are ^'alued. 
An analysis of th(» case studies showetl that few institutions include 
student6 '^as sources in a vvay that results in reliable, consistent, or 
\ cpmparable data. Many institutions employ forms for student 
evaluation uf mstrxlion, but not systematically. In a surprising number 
of oases, studentxS seem to be ii.sed in a casual and sometimes even 
^o.ssipy way as .s'ources of infoimaiion. A large i. umber of department 
or division chairntbA seem to rely hearily on informal student 
comments or complainUs as valid sources of information about teaching 
quality. 

Many chairmen and deans also tend to rely heavil> on informal 
comments from fauilty colleaj^ues. The case study results indicate that 
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- Table 6 

Use of Sources for pecisions on Rcappcintmeht, 
Promotion and Tenure by Various Degree-Type Institutions 



Pereentage Use by Level 



Source cf Information 


^ Doctoral 


Master's^ 


Baeheior^s 


Two- Year • 


Aca lemic bean or V.P. 


81% 


79% 


90% 


— : — = : 

75% \ 


Alumni 


0 


.7 


8 


2 . ^ 


Colleagues 


54 


40 


'32 


13 . \ 


Department Chairman 
Faculty Committee ' 


86 


86 


---^•38 


73 , ; 


61 


50 


35 


12 


Joint Committee 










(facuity/student) 


n 


% 


3 


4 ' 


Peers (other 






1 




institutions) 


32 


4 




President or Provost 


38 


46 


56 


36 ' 


Self-Evaluation 


3?. 


38 


32 


32 


StudenU ' 


47 


5r 


46 


41 



Table 7 



Use of Sources of Information for Faculty Development by 
Institutional Level, Percentage Utilizing 



Percentage Use *yy Level 



Source of Information 


Doctoral 


Master's 


Bachelor's 


Two- Year 


Academic Dean or V.P. 


59% 


75% 


88%. 


86% ^ 


<AIumni - ^ 


15 


12 


16 


12 


Colleagues 


43 


39 


35 


27 ' ' 


Department Chairman 


82 


85 


84 


82 


Faculty Committee 


41 


34 


J 24 


10 


Joint Committee 










(faculty/student) 


' n 


7 


7 


7 


Peers (otlffr 










institutions) 


14 


2 


5 


2 


President or Provost 


27 


36 


45 


32 


Self-Evaluation ^ 


39 


47 


45 


61 


Students 


72 


75' 


79 


84 
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chairmen and deans who do rely on thei»e informal commenfe are for 
the most part frustrated over the inadequacy of these sources, although 
.a few thought they were quite adequate and accurate. Those who 
expressed frustration felt that any s>Mematic information gathering 
about instruction would be resisted by Iheir facuUit's. 

Nevertheless, some institutions do gather systematic^ and reliable 
. informatiorv about instructional effectiveness. Some use student 
evaluation foims, student c6inmittees to evuiJate instruction, formal 
colleague classroom" visitation and reporting, or formal exar>iinaiion of 
"'^teaching, rnaterials. In •addition/ there are departments which ha/e 
appointed Iriterdepaxtmental commitieei> to make foVmal evaluations of 
instruction for the departm.ent chairman to u.se in making 
recorrirnendations. 

One effective and unusual use of studeht^as a hoarce of information 
was found at a doctoral level institution and in ^ professional school. 
Student committees appointed at the departmental level conduct a 
thorough investigation of teaching effectiveness and write a detailed 
repori. of their findings.. In the doctoral level institution the comm.ittee 
consists of both graduate and undergraduate btudent^s. That committee 
conducts jrkndOm interviews with students and other instructors; 
examines teaching mcvteriaU, including examination?,, and interviews the 
instructor. .Several departirient chairmen called 'these reports the best 
^ sourpes of inforrhation ever receiv(/d. ' ' • m 

The general absence of reliable or systematic evidence is a crucial 
factor in the deliberations of tlie department or division ^jhairman or 
^he dean becaus^Jil js at these levels that the evidenct'^is first considered 
and the qualify of piirformance initially designated. The chairman or 
.iean net only initiates the v evaluation process but. also makes the, 
originiil qualitative judgmcMit In the evaluation steps that follow, the 
evaluators see primarrly what the chairman ho^ i>ai*d, rather than the raw 
. data» if Miere were an> . When tliere is no systematic information for the 
chairman to u.se, he .s left to his own devices./rhus, many evaluation 
systems that appear lo be objective actually begin with a judgment 
based on* little , evidence. As U>al value' judgment goes up the 
institutional ladiler, it is treated increasingly as if it were jui objective 
assessment, and at the end of the proooss the detern^inations made by 
the^ chairman often are used as if thiey were entirely reliable and 
accurate data. . ' 

The case studies demonstrated that, w^ith regard tp evaluating 
instruction, department and division chairmen often tend to ^ive the 
, benefit of the doubt to the in.structor and give him or her an ?dequajL^ 
rating unless home overwhelming evidence to the contrary Has come to 
their attention. In .short, in many evaluation .sy^items, instruction is 
presumed to ' be satisfactory' unless shown otherwise. As several 
adjninistrators pointed out in the interviews, thO .t*<i»'lt is\nat most 
teaching evaluation does identify the ver\ ansati.sfa«'tory performers, 
but does not indicate which instructors belong in various categories 
above the merely satisfactuVy. 

« 
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The gathering of information on performance in the research and 
.publication area see»iis to be much more thorough and reUable than in, 
other evaluation areas. Of course publications can easily be countecL 
but there alsO are effective' ways bf judging quality in the research and 
publication area which make use i i of- colleagues in the same 
institution and of peers at oiher instil, .ions. Also, varioiK journals are 
judged" by dieir different rlynitations for quality, and" other sources, 
such as citation indexes, are used widely in doctoral \efe\ institutions. 

For ar^as oth'^r than those of instruction, research and publication, 
the gathering of data'^or evidence on whichjo judge performance levels 
is less thorough and not as sophisticated. IirfactTe\v~insttriTt1<5)i5^aUx^r 
any data at all on performance in areas such as student advising, 
administrative activities, or personal attributes. There are examples of 
institutions which use data gathering forms in the areas of student 
-advising and administrativ^j activitie:> but, for the' most part, 
information on faculty , performance in these areas remains very 
informal. ' 

' ' \ 

Current faculty evalujition practices tjnd to concentrate on 
individual components ^ of sepaiate procedures rather than on 
comprehensive approaches, ^ 
It was found in the case s 



informal at many institution 
to have an elaborate proued 
continue to be vague about 
be used. In non-doctoral k 



udies that almost all institutions use one or 
more individual components^ of faculty evaluation, but that few have 
developed a total Lompreh(>nsive program. Faculty evaluation remains 

IS. Doctoral level institutions aro^most likely 
ire for m'aking (decisions, but many of them 
. precise criteria, standards, and evidence to ^ 

t vel institutions, where all academic affairs 

^re more likely to be dominated by the administration, even the 
procedure by which decisions an^ made is often unclear. 

Perhaps the single faculty evaluation activity^io.st widely used is the 
gathering of evidence through stud(Mit evaluaticJn of instruction forms. 
The use of these forms has become very popular over the past several^ 
years, with many institutions using forms of their own devising. A 
smaller number use professioniiily designed instruments available 
tl^ougli various national orgaui/ations orlnstitutions. It appears that in *^ 
many institutions, however, little or nothing is done wuh the data 
collected from the.se forms, the survey results suggest that.tal)out half 
, the institutions sipiply return the data to each individual instructor. It 
' is unclear what this practice accomplishes. Othor institutions use the 
results heavily for per.sonneldecihion making on the grounds that this is 
^ the on!y informatipn available in th(^ instructional ajreji. A few 
•administrators suggested that they use the student forms primarily to 
give the students a feeling of involvement and responsibility. 

It appears that few institutions have taken a comprehensive ai^i)roach 
Ho developing a faculty evaluation program which begins with dearly, 
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stated i^urposes, and then provides a program likely to bring about 
_ accomplishment of tho?e purposes. Instead, current faculty-evaluation 
^ activities .seem more likely to have been designed in a [)iecemeai fashion 
without a clear vision of either the purpose to bt jachieved or of the 
t^tssf" components necessary for i comprehensive* program. Finally, in a gi'eat 
' many mstitutions faculty evaluation seems still to be. a vague, unclear 
'process, even to administratoi^s most intimately involved. 



ppnseq^ences of Current Practices 

The key issue in considering the consequences of faculty ^valuation 
^ seems to be whether or not current practices adiieve the purposes^ 
desired. A second is^ue concerns the effects which evaluation practices 
have on the-institulions using them. 

Do present practices achieve their objectives ? 

^ (. The objectives of encouraging faculty development and improvement 

and of making fair and appropriate personnel decisions should satisfy 
almost all concerned. A glaring pi;oblem with present practices is that 
c^ten there is little evidence that they effectively stimulate or assist 
with faculty development and improvement. This statement assumes 
that the term facility development and improvement refers to a set of 
, - ^ practices or activities which provide positive assistance for change and 

improvement of the faculty. While a small number of institutions in the 
region do have organized practices of this kind, few are directly 
associated with the results of evaluation. It seems fair to conclude that 

, -li^ihe chief purpose of evaluation ks the promotion of development and 

improvement, then some link between objectives and practices would 
* be essential. 

' On the other hand, it it^elear that somt admmistrators use the term 

development iind nnprovement to refer to the end results of a personnel, 
decision making process that retains and rewiirds top performers and 
terminates the remainder. There is some evidence that this purpose is 
achieved in a number of institution^ primarily doctoral and master's 
level that have a .syhtematic fac ulty evaluation program in operation. 
However, as described in more detail below, some institutions achieve 
this result at considerable expense to institutional morale and perhaps 
to overall institutional effectiveness. 

The findings of the survey and the case studies indicate a fairly 
strong l^elicf ?mong adfninistrators that sufficient data are being 
generated lipoii which to make personnel decisions. The problem is, 
however, that when one looks into the data, grave weaknesses are 
apparent. Casual comments by students and faculty members are relied 
on very heavily— -a practice that appears to contribute to a_cjeneral_ 
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distrust of evaluation systems. Few instituticms ^utside tiio doctoral 
and master s level gather evitlence on "faculty performance in systematic 
„ways, causing one to question the validity of the ultimate^de^Msioiis. 
Those institutions which haVe comprehensive evaluation progfmnii,...^^^^^ 
including systematic approaches to data gathering and judgment making ^ ^ 
appear to arrive at fair and appropriate personnel decisions and achieve 
general accepUmxre of the process by Ihe institutional community.. 
Components of some of these progi-ams are described moro fully in 

"^^^^^^^ ■ What are the effects of current practices? 

The final question on th.e survey questionnaire asked the 
respondents: Please descnife briefly what you tlunh have been the 
major (gooclor bad) consequences of your faculty evaluation program, 
e.gl changes in faculty morale, in the instructional process, in the 
quality ofpteaching. Only slightly more than half of the institutions 
, responded . to this question ami .sixty-three others stated that such 
assessmejU of their programs would be premature. The 388 responding 
' institutions listed 645 consequiMices, of which the ^^'good!* out- 
numbered the **bad'* about four io one. Judging-4>y the small number 
of responses to this question and the vagueness of the responses 
themselves, it is clear thai one of the grealest unknowns about faculty 
evaluation is the effect it has upon the institution as a whole or upon 
the faculty. *^Good'* effects which were reported by respondents, in 
order of frequency, were improvement of teaching and/or counseling, 
improvement of morale. improv(»d faculty -adnunistrative relations, 
avoidance of inequities, involvement of students, improvement of 
laculty motivation, improvement of relations betweeiv faculty and 
•students, and facilitation of administration. The most frequently 
reported *M)ad" effects were negative cfftn t on mo'ral(\- ineffectiveness 
of the evaluation s^\stem. faculty oltjections. and misust^ by faculty. The 
difficulty with these findings is that we are noi sure which tyi^e 
evaluation progi*ams \mvo what effiH'ts. ^ 

An attempt was made in the ease studies to distinguish the 
consequences of faculty (Valuation a( tivities as they differ lietwecn 
institutions with informal a|)pn)aches and institutions with more 
systematic, comprehensive a|)proarhos. Institutions which hav(^ 
informal, seemingly vague aii^proachcs to faculty (^valuation tend to 
have le.ss faculty turnover than ihose institutions with systematic 
approach(»s and facultN ptM-sonnd decisions ap|)car to Ik* very difficult 
to make and are usually put off until the last possible opportunity. 
Satisfactory faculty ixn-formancc st'cms to l)e assumed in these 
institutions, with pe**«nnnel action being taken |)rimarily when major 
adveise circumstani cs arise. 'Ihe ( riteria and .standards for promotion 
are obscure, and many j>roin()tions seem ii) be automatic when a certain 
amount of time hits pa^sed. SaKu\ mu'eas.'s rarely are given for merit, 
but rather on an across-the-boarti i)asis. Tl.e decisjon making i)ower in 
these institutK>ns tends^to vvs}^ (xiluMveiy _\\iUi liiu ,dcpartmeiit — 
"cnaiFmenlmcl ThFacademic deans. 



25 

29 



.InstitutiOTS wijth- informal approaches usually encounter major 
problems wlien it becomes necessarj^* to make a negative personnel 
decision, especially if the facuUy member involved wishes to contest 
the decision. Often the institution has no criteria or standards by which, 
to define acceptable and unacceptable performance. Evidence of a 
faculty merftier's performance is usually acquired through informal 
procedures or from sources which the institution^ often~i6 unwilling tc 
reveal. In' addilion, Iheso procedures do not result in evidence which 
permits formal comparisons because the approach has been so iliformal 
and possibly different for each facultj^pember. The institution is^likely 
to have difficulty demonstrating tfiat it has used fair procedures or 
allowed for due process, especially if. the department chairman and 
dean'^simpiy meet together and discuss each situation. The result often 
seems to be that negative personnel decisions, are so unpleasant and 
difficult in these institutions that they either are postponed to the last 
possiblfuijoment or avoided altogether. 

On the bthet hdnd, there ai-e those who find the congenial and, 
collegial atmosphere of evaluation at these institutions rnore effective 
and more likely to genei-ate^development and improvement. One _ 
academic vice president of a master's. Jevel institution which recently 
adopted a systematic approach to evaluation would like to return to an 
informal, coUegial approach. He states his views as^ollows: 

rd scrap the whole thing and go back to the days when 
chairmen and deans talked in detail with faculty members 
about performance, expectations, and processes for 
improving performance; although our [current] process 
would, Tm sure, pass muster in the eyes of today's academic 
world. Indeed, I would postulate that it would be described 
as exemplary. Nevertheless, I would opt for old-fashioned, 
less stratified, less ritualized processes. I believe results would 
— ' be as good and trauma would be greatly lessened. 

Visited mstitutions with systematic approaches to faculty evaluation 
reported both positive and negative consequences. The major positive 
consequence reported was that better personnel decisions are being 
made, with the result that marginal faculty members are being 
terminated sooner, strong faculty members are rewarded for their 
strengths, and all are stimulated toward improved performance. 
Administrators at several doctoral level institutions reported that they 
R)elievt the overall quality of their faculty has improved, and that 
faculty tenured before adoption of the present system perfprin better 
now than before. Concrete evidence for increased productivity in the 
area of research and publications is availably in some of these 
iijistitutions. Evidence for improved instruction usually is not available, 
but many administrators have the general "feeling" that instruction has 
improved as well. Using the results of systematic e valuation to assist 
individual-" faculty "improve i:heir performance or correct certain 
nJistakes is unusual^ however. Most often, faculty simply receive their 
evaluation results each year and are left on their own to take what 
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actions they wish, Convorsalions about perfonviancc UMially must be 
initiated by the faiiuKy member. 

Additional positive consequenci^b reporlod by administrators m 
institutions with systematic cvaUiation programs are that the prot^ram 
provides them a data base not onlj on which personnel de. isionb can be 
made/but' also on which Ihey can be justified, il' iieed l)e, to courts 
andj'or governmental agencies, Admn^istrators^in lar^e universitiob also 
feel their programs provide additionjil information a1)out the strengths 
and weaknesses of individual departments and jMograms whicli they 
otherwise might not receive. 

The major negative c^nsequi-.^e of systematic faculty evaluation 
prograpis revealed through the case studies was that of increased faculty 
anxiety, lower faculty morale, and in several case^, complete faculty 
rejection of the evaluation program. Reali/.ing that evaluation is by 
nature threatening, some instilulions have taken stcjxs to minimize the 
anxiety level and thereby to increase accepUmce, Tlie most successful 
such step appears to be to increase the role;i)f the faculty m operating 
the evaluation progi-am. In the progi'ams with the lowest faculty 
anxiety level, faculty have been involved in the design of the program, 
in its formal adoption, at key levels m the process, and m the evaluation 
of the program itself. More specific e.\am()les of the roles faculty play 
in evaluation programs are given in Sectfon 2. 

Another practice which seems to lower the faculty an.xiety level is to 
have the evaluation program as* open as ()o^:>ible. One institution had a 
major problem, for e.xample, when it kept th,^ membership of one of 
the faculty review committees secret. Not all institutions with 
systematic approaches allow faculty access to all written information, 
histitutions which do not allow acce.^s to all written materials provide 
summaries of the materials, either in written or oral form. In no case 
was it found that negative comments are kef)t from faculty, but in some 
cases the name of tht person making the comments is withheld. 
Another m.stitution which allows open acce.^> tb all materials has found 
that the number of per.sons pr(^mot**d and tenured has increa.^ed under 
the current system. Several aclmmisvrators pointed out that a major 
problem in implementing a systematic e\aluati()n i)rograin, which 
requires wutten evaluations basetl on si)ecifie(l criteria, standards, and 
evidence, is getting department chairmen to do thrtr jobs adequately. 

It IS clear that there are l)()th positive and neualive eonst'cjuence^ to 
i)oth informal and systematu approaches to taeully (»\aluati()n. Niulher 
approach is likely to aiitomatu allv ha\e only positive outcomes. -The* 
end result of a particular a[)pioach aj)pears U) dept^id to a large (extent 
on How the progratM is adopted in the bemnninu and the e.xtent of 
faculty in\()lvenirnt and n^sponsibilitv lor i)rograin opcratums. 
Section 3 will (i»'al with strat^^u'ies for initiating, (level()i)ing, and 
Q f)eratinu svstem at ui^f.^n idty j '\ al uaUoil VJ' >i;i:a]Ib- JirAt_^ S<:(AlonJi. 
will describe a framework for sudi pr(. grams. 
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Section 2 

Components of a 
Systematic Faculty 
Eva^luation Program- . 



\ 



m t was pointed out in Section 1 that iwo key characteristics of 
current faculty evaluation practices are (I) that there is little evidence 
that current practices achieve the objectives set for them, and (2) that 
most evaluation practices are not organized into comprehensive pro- 
grams. Analysis of t'le SREB case studies of faculty evaluation suggests 
these two cliaractenstics ma> he closel> related. Institutional eValuation 
programs ap])oaring most nearly to achieve their summative and/or 
formative objectivos those which had identified and* fully 

developed various components which make up a comprehensive 
evaluation approach. In many institutions it seems that a large amount 
of data IS collected regardm^ faculty performance, with little 
consideration ^iven to why these data are htMn^ $?athered and how they 
will be used to achieve desired obiectiV(\s. In short,- few institutions have 
approached faculty evaluation in a systematic and comprehensive way. 
As a result, man^i institutions carry out a number of isolated practices 
with little overall impact. 

One outcome of the SREB study of current practices has been the 
identification of components which make up a systematic approach to 
faculty evaluation. As a result, wo have developed a framework for a 
systematic faculty evaluation ])rop-am which wili be presented in the 
remainder of this section of the re])ort. We hope this framework will 
serve both to clarify the conce])i of systematic faculty evaluation and 
to provide j4Uidelin(\s institutions (an use in developing proj^rams of 
their own-. This framework is int< nded to o ffer an " approach wh ich 
includes Tliose compontMitTc^^ pro^^ms as \wol\ 

as one that allows institutions to design the details of each evaluation 
component in accordance with tht ir own individual needs and 
circumstances. 
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Four separate componenti* of systematic faculty evaluation proj^ams 

. were identified throug4vUie c as e .s tudies. -The four compQnent6i,-.itvw,hat 

: _ appears the logical order for development, are as follows: 

- ■ !• Purpose— The objectives, or desired outcomes, o( the 

— ^.j, evaluation program clearly stated can guide to further 
• ^ . development and operationfoi" the program. 

2. Areas— The areas for evaluation are those function's or * 

attributes that are to be exammed^in determining faculty 
effectiveness. Traditionally, »the three main areas of faculty 
activity have been assumed to be teaching,, research, and 
service. However, additional areas have been identified. 

3. Elements— The three essential elements of any evaluation 
program are criteria, standards, and evidence- Crrteria are 

, _ specific measurable attainments subsumed under each 

evaluation area Standards are the Jevels_of attainment ' 
which are expev vod or defined for each criterion. Evidence ~~ 
is data or information gathered as the basis for determining 
performance levels for each criterion. Evidence also 
includes the'methodology used in gathering the. data. 

], » * 

4. Procedures— Procedures are the steps designated by a flow 
chart or other device for examining and applying the 
evidence to determine level of achievement for each 
criterion. Clear procedures are needed in making personnel 
decisions and in providing assistance for development and 
improvement, or for achieving objectives of the program. 



Figure 1, shows these four components in graphic form. 

The figure suggests an order in which J*he four components of a 
faculty evaluation program may logically be developed hy an 
institution. While few institutions were found to have followed this 
stup-by-step process precisely, a larger number of institutions which 
clearly have all four of those componcMits as part of their faculty 
evaluation progranLs wa^ idi iitified. In fact, it is undoubtedly true that 
all faculty evaluation programs or activities include parts of all four of 
thesp components, although in some cases it may be difficult to locate 
them all. 

Examples drawn from the SRKB ciise studies of current practices will 
be used to describe these four components of faculty evaluation. 
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1. Purpose of Evaluation 

The literQture of highrr ediu-alion giMieraily confirms the SRKB ^--r;'^^ 
survey finding tliat there are two main purposes of current faculL^.. 
evaluation practices. ( I) providmg thita for making fair and appropriate 
personnel decisions, and (2) providing assistance or stimulation for 
faculty development ahd improvement. As pointed out in Section 1, 54 
percent of tlie respondents to the SRKB sur\^ey stated that the 
formative purpose was the most important in their, insjitutions. 
However, the resuhs of the case studies of cuncnt practices led to the 
conclusion that the summatixc function is more important in practice. 

There seems little point in quibbling over which of these two 
purposes she \0 be more important as institutions go about developing 
sound, systematic faculty evaluation practices since a good argument 
might be made lhat both of these purpo.ses are indispensable. (Vrtamly 
all m.stitulions must make pt^rsonnel devisions, and they ought to devise 
a process by which those decisions can be made<n a fair, equitable, 
timely, and acceptable m^mner. By the same token, it is difficult to 
imagine an institution that 'does not wish to provide assistance and 
stimulation for faculty development und improvement. St) it would 
seem appropriate for institutions to consuier i)oth of fhese purposes 
important-perhaps equally important. As pointed out earher, some 
institutions do indeed find it difficult to sepjirate the summ.ative and 
formative purposes. Some institutions consider these two purposes to 
be one. This is esi)ecially; true m institutions where development and 
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improvement are looked upon as applying to the faculty collective y 
jather than' individually , 

Table 1, in the preceding section, indicated importance attributed to 
additldnal purposes of faculty c\aluation that were listed on the survey 
-.questi.onnair£^l3ifi_catiegrn£5_^^^ Jnstructor with diagnostic 

infprmatipn on teaching effectiveness and a basis for general faculty 
deifelppnjent and improvement are sufficiently similar that both can be 
considered formative purposes. It was found in the case study 
iriteryie^s, in. fact, that these two concepts often are used 
interchangeably by administrators and faculty. Table I also shows that 
*the ^purposes entitled *hssure equity of employment practices arjd 
fesearch data are not considered significant in current practice. Assuring 
equity of employment practices probably is considered subsumed under 
..the summative function by most administrators. It appears, therefore, 
tHat the two categories of summative and formative purposes cover 
rather completely the responses to the SREB survey. 

An additional purpose of faculty evaluation programs identified 
throu^ the .case studies arrd noted earlier was that of facilitating the 
management process, A number of institutions begin each academic 
year by having each faculty member prepare a ^'distribution of effort" 
^agreement with his or her department chairman, setting forth explicitly 
the faculty member's responsibilities for tiie year. This agreement 
specifies the. evaluation areas and the criteria for that faculty member'% 

evaluation. This process provides ^a means for assuring that all 

departmental responsibilities are covered, and for dividing__tbe_.\v:Qrk. 
load in accordance wiih the s:trengths and Ucsires of individual faculty. 
It also providers a process for individualizing evaluation. Eac^ member is 
evaluated on the basis of his or her own responsibilities, rather than on" 
general expectations for all faculty. This prpcedure allows faculty to 
concentrate on different activities in different years. For example, in 
some years the agreement may provide that a certain professor 
concentrates on teaching a greater than average load, with an agreement 
that he or she will not be expected to prepare publications that year. In 
this case, that faculty member would not be evaluated on publications. 

The purposes of faculty evaluation programs are sometimes stated 
clearly, sometimes vaguely. Several examples of evaluation program 
purposes taken frrm the institutions studied are listed below: 

''The prmxary purpose of the annual performance evaluation 
of all ^faculty is to promote individ d and institutional 
w self-improvement. - • 

''Evaluation for promotion^ tenure and termination has as itt> 
sole purpose continually upgradin/f the quality and 
performance of the faculty. 

"The purpose of the present evaluation and management 
system is to assist the faculty member in promoting student 
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learning, and to reward each faculty member in proportion to 
i>v the extent that he promotes such student learning, 

**the overall objective is to proOide the fullest and fairest 
possible evaluation to insure: 
, a, that the faculty member has optimum assistanc^U^helv 
him realize his^ maximum possible potential; 

.b. that we are as fair as possible in extending rewards, e.g. 
merit increments, promotion, tenure>^ 

c. that we ^e able to eliminate Jhose who have failed to 
remedy shortcomings of^smajor moment in teaching, ' 
research, and service. " 

'The. primary goal is faculty development, the improvement 

of 'teaching through feedback. There arc secondary goals 
involving the pay, promotion, and tenure process,'' 

''The overall objective is to get the best possible professional 
judgment made and to ensure that recommendatiov- are not 
capricious or arbitrary. 

''Qbjectives of our evaluation prograins are: 

a. To keep and maintam a history Of the performance of 
an individual throughout his employment at . , . College: 

b. To identify superior performance and to identify 
marginal or unsatisfactory performance; 

c. To give recognition and motivation to those individuals 
who are performing in cn outstanding manner. 

It appears that clarifying purpose, objectives or expected outcomes, 
and achieving institutional agreement on them, is the first step in 
developmg a faculty evaluation program. Taking this step provides the 
foundation on which the program can be developed. Without taking 
this step first, institutions are likely to have no clear guidance on what 
procedures to adopt ana how those procedures should be used. The 
way the purpose of the evaluation program is determined may be as 
important as the substance of the decision itself. Without agreement on 
the program^ purpose by all affected constituencies, ti}e likelihood of 
jts achievement is small. One possible explanation for the finding that 
current practices do not generally achieve their formative purpose may 
be that this purpose was stated after the program had been established, 
and that the purpose was not agreed to or recognized by all 
institutional constituencies. 
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2: Areas for Evaluation 

^ , Evaluation areas are those broad aspects of faculty functions or 
attributes which are to be examined in determining a faculty member's 
effectiveness.. Traditionally, faculty activities have been referred to as 
|f ailing into three areas— teaching, research, and service. Table 8 shows 
,the/percentage of mstitutions which assigned certain ranks to various 
'evaluation areas napied in the survey questionnaire. Table 4 in 
Section, l^ve t\\\s sjixne information by institutional type. 



Tabic 8 



Ranking of Evaluation Areas for Faculty Evaluation 



r 



Evaluation 
;Area 



^M<iAcliyi]ty in Profes- 
L'^;^7^a5al'Sbciet^ 

r 'Administrative * 
T^/^Actiyities 

Civic Activities 

}\ f \Inslructiondl 
4^Activiti€s. 



' .Personal 
Attributes 

; /tPublications 

:.,Public Service 

{ \ Research 

, Student Advising 



Percentage of Institutions Assigning 
Respective Ranking^ 

1st .2nd (1st to 3rd) (4th to 6th) (7th to 9th) 



2% 


10% 


30% 


44% 


11% 




8 


33 


69 


25 


2 




1 


4 


19 




20 




96 


3 


99 


0 


0 




11 


32 


67 


22 


4 




6 


14 


33 


31 


16 




2 


6 


22 


33 


21 




9 


18 


41 


29 


12 




9 


44 


75 


17 


2 





^Columns may total more than lOO'I because respondents were allowed to assign a 
given rank to more than one choice. 



These tables sho\s that for all institutions the four most important 
evaluation areas in current practice are instruction, student advising, 
administrative activities (including committee work), and personal 
atrributes. Doctoral institutions rank research and publications second 
and third, and student advising fourth. A similar ranking was found by 
Seldiii (1975) in a survey of liberal arts colleges. HeTound that the four 
most important evaluation areas were classroom teaching, student 
advising, length of service in rank, and personal attributes. Committee 
work ranked fifth in Seldin's survey. Astin and Lee's report on their 
1963 survey (1967) shows the -same results as Seldin's. There is little 



mystery ,jMierefore, about what the major faculty Jjctivity areas are. It is 
clear that different^institutions have different ideas about which areas 
are most important, an^ what weight should be assigned the various 
areas. -Institutions have different missions, and thus it is appropriate 
that ekch institution deter^hie the importance of faculty activity areas 
in accordance with institutional purposes. 

The ^^distribution of effort*' agreements described above provide a 
means for weighting faculty activity areas in accordance with the 
desires of. the institution and also in accordance with the specific 
responsibilities of each individual faculty u»ember,. Faculty members 
net having student advisees, for example, cannot be evaluated in the 
advisemeni area even though, the institution may look upon that area as 
an important faculty activity. It is important, therefore, to look upon 
identification of evaluation areas as a decision .to be made for the 
institufion as a whole, separately for units wHhin the institution, and 
for 'faQuJty members individually. This is particularly important for 
large^nstitutions which have faculty performing many diTferent sets of 
activities. Sevefal doctoral, level institutions which wore studied allow 
, each department to establish as v/ell as to set the weightings for the 
areas to be evaluated. In another doctoral level institution the various 
colleges have responsibility for ehtabiishing the evaluation areas and 
weightings for their respective faculties. 

In addition to those stated in Tables 4 and 8, other subjects of 
evaluation used by institutions m the region include: academic training, 
experience, length of service in rank, competing job offers, and 
consultation. 



- 3. Evaluation Elements 

Determining the areas of faculty acti\ily that are to be examined in 
an evaluation progiam is not sufficient for jiwaluating those areas. 
Making a judgment about the le\el of performance of a faculty member 
in a certiun activity area requires that one also have (1) criteria on 
which the area can be judged, (2) standardi; against which the extent or 
degree of ach.evemonl can be determined and (3) evidence on which to 
base the determmation of the standard or level of achievement. Criteria, 
standards, and evidence are needed for each area to be evaluated. 
Whether or not an institution can develop criteria, stiuidards,, and 
evidence for an evaluation area may help determine whether that area is 
appropriate for evaluation. o * ^ 

Criteria. 

Specific behi*viors, features, measures or indicators to be examined 
for each cvaUlation area are the criteria for evaluation. It was found in 
the case studies that sonv institutions have difficulty generating 
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appropriate criteria for e^ich evaluation area, and th^A*some generate so 
many criteria that the system becomes unmanageable. One test for vaHd 
and workable criteria is whether or not it is, possible \§ develop both 
standard^and' evidence for each. X * 

An example of one way to begin the process of developing criteria is 
to' ask the question, "What do we need to examhie in order to 
determiiVe a faculty member's performance level in instruction?" Other 
evaluation areas, such as studept advising, committee work, research, 
publication, etc., can be substituted for the \Yord instruction. Answers 
to the. above question can be generated* from varous institutional 
constituencies and a common, acceptable core of criteria can result. 
Gle^ly. there are no established complete sets of criteria. available for 
usejn various evaluation areas. Therefore it eeefei^the best course /or an 
institution to follow is to develop its* own criteria by involving all 
constituencies within tfte institution. This process seems most likely to 
assure acceptance of the criteria, and^ later the success of the program. 

Institutions studied use both quantitative and qualitative criteria. 
Some refer to their criteria as objective and subjective, Vather thiji 
quantitjitive and qualitative, but these two sets of terms seem to have 
siijiilar meanings. Most Institutions use a combination of quantitative 
and qualitative criteria, although somtruse a quantitative approach to 
all criteria, standards and evidence. * * 

Examples of quantitative criteria for instruction usec^^by institutions 
studied are the following: o 

— enrollment tfends 

— number of students who become majors 

— number of students who withdraw 

The following are exartiples of qualitative criteria for tlie- 
instructionaParea: . ^ ^ ^ ^ 

— extent of student learning 

— student understanding of course objectives 

— current and relevant syllabus and other course materials 

— performance of students in higher level courses 

— clarity of classroom presentations 

— success of students after graduation 

Examples of combined quantitative and qualitative criteria in the 
research and publication area are: 

— number of publications 

— quality of publications « 

— number of research grants 

— citations in other publications 

— speaking or consulting invitations 

— author's reputation in the discipline ^ 

Some evaluation areas, such as that of personal attributes, may 
present more difficult problems in developing criteria. Examples of 
criteria that are used in this area by some institutions include the 
following: loyalty to the institution, honesty, punctuality, and 
neatness. The^reas of student advising and administrative activity also 
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give difficiilty to some institutions. Examples of criteria U3cd in the 
student advising area are: student satisfaction, numbor of students 
advised, number of students who change advisors, and numbor of 
advisees who experience difficulties, hi the area of administrStive 
activities, criteria include: number of committee or other administrative 
assignments, effectiveness . ai committees, l omplotion of admin|strativo 
work, and cciloaguesatisr.*ction. . * i ^ r 

Another approach to developirt^i criteria for (^vakiaung the area ol 
instruction has been proposed by Meeth (1976). Baohighis proposal on 
work in' another conte.xt by Robert Thomdiko, Meeth suggests three 
categories of criteria-ultimate, intermediate, and immediate-that can 
be applied to teaching. Ultimate criterii( are based on student learning 
gair\?, intermediate criteria on the process or methodol'>gy of teaching, 
and immejiiate criteria on the sense of the learning experience. 

< In this approach, immediate criteria are judged by student 
satisfaction and the evidence used is primarily student ratings of 

^.instruction. Some 'examples of Moeih's mUTmediale and ultimate 

^ criteria are as follow^: ' 

^ ^ ' Inlcrmc.di**^^^^*^^'*''^* 
Studeius were motwaled to knirn. 

The structure of the learning experience was delormmed by 
the goals of the exponence. 

The content wa*; well ordered, comprehensive, and 

^appropriate to the abilities of the learners. 

Rewards and sanctions wen» appropruite to the goals of the 

learnnVg expeniMice. ^ 

Goak -iiid/or outcomes w(Me c learly specified. 

Kvaluation tritena. standards, and nit^iiodologies were clear 

and appropriate to the uoalsM)f the t^xpenence. 

Methodolog\' was appropriate to the ^'aal> of tht^xpenence 

and the abilities of the learners. ^ 



' rilinnilc Cnicna 

The sUulents learned whal'thi' mstnu-tor was trying to teach 
-in cognuive. affeetue. and-'or ps\ehoim)tor develop- 
\ment * 1 

• - in rate and or absolu^-;icliuAfmentV 

Students retained what ^^as learned. ^ 
Teacher goals and or outcomes for the learning experience 
were met. ^ . •« 

Student goals ami or outconv's" for the learning i\\t)enenoe 
were met. ^ • ,x ' ..-^ 



The.lfearning experience* related to other learning experie^ices ' 
students might have had (congruence, continuity, sequence): 
prior learning was capitalized upon; learning incrfeasyd in 
other formal experiences, the -students had at the same time; 
learning improved in the rest of a sequential ^r^es the ] 
students had afterward, I ■ 

. .Enrollments-levels were sustained or increased in subsequent 
Cofferings of the learning experience. ' i 

-''Whatever ^he approach used to 'develop criteria, the best 
recommendation probably still is for each institution to go through the , 
:prbces& for itself. On the other hand, there fias been considerable » 
research into the i:eliability of various criteria, particularly in the area of , 
instruction. Institutions may wi^h to review this literature \n advance to 
help avoid possible mistakes. Centra (1976), Hildebrand, <?i, ai (1971), 
and Smith (1977) are good places to begip. 

Standards. 

The reason for setting .standards in the evaluation process is so 
perforn\ance can be evaluated only against stated expectations. Levels 
of expectation ar^ always present in evaluation situations, however they 
often, are so vague that it is almost impossible to know what they are* 
Faculty members continually use standards in assigning examination 
and course grades, even though they rarely are^ stated publicly. By the 
same token, standards are applied^ when institutions make personnel 
decisions even though those expectations ma> not betirticulated. 

^The term "standard" may be defined as any definite rule, principle 
or measure to which something can be compared. In the academic 
world, when the. word ^andard is used, it usually is assumed that 
soi^ewhere there is a reference group or reference point to whic^i a 
person's performance is/compared. However, recent discussions have 
dealt with two kinds of standards: norni-refcrenced and criterion- 
referenced. When norm-referenced standjirds art* used, a faculty 
membery,performance li, compared agamst the performance of his or 
her peers. When criterion-refer need standards are used, a faculty 
member's performance is measured against pre-set levels. In (he 
framework thaf is being proposed here, it is nece.ssary to have clear 
standards of some type for each criterion. The u.se of both norm- and 
crilerion^referenced standards was found in the case studies. 

Norm-referenced btand«irds were found to be used in circumstances 
where there aro scarce resources to distribute, such os promotions, 
tenure, and Scilary increases. In some institutions for examj)le, only a 
certain perjientage of^assistiint profe.ssqrs ma> be pBumoted to associate 
professors, or only a'certaih percentage of the noirtenured faculty may . 
be granted tenure in a given year. In such circumstances, individual 
faculty members' performcinces are compared to each oth^r, and only 
those in a certain percentile are chosen. Norm-referenced s|:andards also 
are used when an institution finds itself in a retrenchnjent situation 
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which makes it necessary to reduce faculty. Norm-referenced standards 
might be compared to the practice of "grading on the curve." 
•^Criterion-referenced standards are precisely set and stated m advance 
of th^ir application. .Faculty performance is measured against these 
pre-set standards without regard to how many faculty fall within, or 
above, or below the standards, ^ost institutions studied claim to have 
criterion-referenced rather than norm-referenced standards, but rarely 
are these standards precisely stated. Terms, such as "ou^tanding," 
"satisfactory," "unsatisfactory," often are used with little i??planation. 
fs Criterion-referenced standards can ie stated either qualitatively or 
quantatively. Some institutions use a totally quantitative approach, not 
only to setting standards, but also to defining criteria and evidence, an 
approach recommended by Miller (1972). One institution has 
developed a numerical rating system of 1 to 5 for all criteria. This 
institution also gives a qualitative adjective and a short descriptive 
explanation for each numerical rating, as follows: 



Rating Quality 



Explanation 



Poor 



Fair 



Good 



IS gen- 
in this 



Very Good 



Outstanding 



not 



The faculty member's performance 
erally unsatisfactory -or inadequate 
area. 

The faculty member^s performance is 
entirely satisfactory and needs to he im- 
proved. ImprovemejU may come with experi- 
ence, but increased effort may be needed. 
This rating means the faculty member's 
performance in this area is generally adequate 
and definitely acceptable. It should be given 
when a faculty member performs at a level 
which corresponds with expectations for most 
faculty members. 

This rating should be given if the faculty 
member is above average with respect to the 
trait or standard. It should be given when a 
' faculty member demonstrates above average 
talent and effort. 

This rating should be given only in exception- 
al cases. It should be given only when a 
faculty ^member demonstrates rare talent and 
performance with respect to the area or 
category. A rating of superior should be 
supported with a stateni?nt documenting the 
basis for the rating, giving concrete examples 
or evidence, especially if more than 2 or 3 
categories or items are assigned this rating. 
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Some feel that one problem with a quantitative approach to 
standards is that much academic work cannot be quantified. Another 
problem identifiedjs that average or composite scores are comj)Uted in^ 
most, such systems and therefore one has to be able to accept the 
assumption that all rated criteria are equally important. Moreover, the 
same assumption is said to be applicable to the questions on various 
forms, such as student and colleague evaluation forms, which are used. 
-If a composite or average score is to be computed and used, one must 
assume^^the argument goes, that all questions have the same weight. 
These '^sumptions sometimes are difficult to make. 

Another institutiorv states that it makes both a "quantitative 
assessment and qualitative judgment of (each faculty member's) 
activities. . . The quantitative assessment is made by each faculty 
member on an annual Academic Personnel Report. The qualitative 
assessment is made by following a procedural" flow rhart which this 
institution uses. The qualitative assessment terms used at this 
institution are ''marginal,'.' '^professional," and *'exceptional achieve- 
ment." Some departments use a numerical ranking system of 1 
to 5 in making the qualitative judgments. The dean at this institution 
has made the following statement regarding his understanding ^of the 
rankings of 1 to 5: 

The mid-rating, or 3, on this continuum seems the critical 
one since it connotes a satisfactory' level of performance. So 
far as the Dean's office is concerned, this rating indicates: that 
during the past year one has done reasonably >veH those 
teaching, research, and service activities that he or she is 
employed to do. This means that an occasional publication, a 
satisfactoiy evaluation for teaching, and a not unusually 
heavy service contribution,, might very well characterize the 3 
rating. Indeed, if those are the expectations of the position, it 
is difficult to conceive of a slight departure from ^that 
expectation warranting either a rating of oxeellence or 
extreme marginality. 

It i.s of intea^st to note that at thhs institution, nearly 90 percent of the 
total faculty scored 3 or above. 

Anothif institution uses a numeriiiil svsti m for applying standards 
for merit raises and also provides a descriptive explanation of each 
rating. This example repre«;ent.s a comhination of norm- and 
criterion-refiTcnLed standards. Cate^i>ries for merit raises are as follows: 

Category /—Faculty member doing a truly outstanding job in 
five (5) areii.. This ^» oiikl l)e limited to a maximum of 
of your faculty unless you and the dean xigree that there 
are some unusual circumstances m your depiirtment. 

Category //—Faculty meml)er doing a good, above average, 
meruorious Jol) when judged against the standards of what is 
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considered an ideal college professor. This category signifies 
that the administration of the university is satisfied with the 
manner in which the faculty mem*ber is carrying out his/her 
job. (Jip percentsge'timits on this category.) 

CaV^gox^ llJ^acMiiy meml ing a less than adequate job 
.and'helds to^prove his/her performance. Thi^ raise is used 
} to signify to the faculty member that he/she needs* to 
; improve his/her performance. (No percentage limits on this 
•J^ category,) ' j 

Category /V— Faculty ' member not performing the job 
• expected of the faculty. This category signifies a "zero" raise. 
(No -percentage limits on this category.) 
Some institutions also state standards for each academic rank. These 
standards may be stated quantitatively or qualitatively as well. Below 
iire t\yo examples of stating standards qualitatively for each rank: 



hxample 1 

Professor. To be eligible for tho rank of professor, a faculty 
member must have a record of outstanding performance 
normally involving both teaching and research or creativity or 
performance in the - arts, or recognized professional 
contributions. As a general guideline, the faculty member is 
expected to hold the earned doctor's degree and to have at 
least nine years of effective and relevant experience. • 

Associate Professor. To be eligible for the rank of associate 
professor, a faculty member must have a good record of 
effective performance over a probationary period of time 
usually involving both teaching and research, or creativity or 
performance in the arts, or recognized professional 
contributions. He must possess strong potential for further 
development iis a teacher and as a scholar. It is normally 
expected that he will hold the earned doctor's degree. 

Ai;.^istont Professor To be eligible Cor the rank of assistant 
professor, a faculty member mu,st po.ssess strong potential for 
development as a teacher and as a scholar, lie will normally 
be expected to hold the earned doctor's degree or its 
equivalent. 

Instructor. To be eligible for the .rank of instructor a faculty 
member must normally hold the ma.ster's degree or bachelor's 
degree plus substantial additional graduate study-such as 
evidence of having fulfilled the requirements for admission to 
candidacy for the* doctor's degree. 



Example 2 

Professor, A promotion to the rank of full professor is an-- 
indication that in the opinion of coUeagueSj thisiiiliivTHuaT is 
outstanding in teaching- andnlTiesearch or other <;reative 
_productlvity and has earned national and perhaps inter- 
, national, recognition. It should be further stressed that this 
rank is a recognition of attainment rather than of length of 
service. 

Associate Professor, The promotion to associate professor 
should be made only after an indication of continuous 
improvement and contribution of the individual both in 
teaching and research or other creative productivity. 
Furthermore, the- indivkjAial should have ' earned some 
regional recognition foi>eiccellence in his field. 

Assistant Pro/csspr; Appointment or promotion to the rank 
of assistant Drdfessor should be made when' it has been . 
determinepl-^at the individual has a current capability for 
good teaching, research and university service and a potential 
for^ipiificant growth in these areas, and the terminal degree 
^^l5propriate to his field. 

^ Standards may be the most dj^icult element tp develop and put into 
effect at the institutional level since many institutions seem accustomed 
to stating standards broadly, as in the two examples above. It is 
important in this framework, however, that standards be stated for each 
criterion in each area being evaluated. If standards for each criterion 
cannot be stated or agreed upon, it may perhaps indicate an 
inappropriate criterion. 

Evidence. ^ 

Evidence is the information or data compiled for determining the 
level of attainment for each criterion. This clement also includes the 
methodology dvsigned for collecting the evidence. Most institutions 
have begun gathering various types of data on faculty performance, 
although usually not in a consistent and rtliable way, and often not 
applied to specific criteria. Many institutions seem to treat the 
collection of evidence as if the accumulation of data alone constituted a 
comprehensive faculty evaluation and development program. However, 
in the framework presented her the gathering of ^'ata must be seen as 
simply one evaluation element which accomplishes little if not seen in 
its appropriate context. 

Once criteria and standards have been determined for each evaluation 
area, the next step is to establish the evidence *hat can be compiled to 
judge the achievement of those criteria. As bei . , an effective test of 
whether specific criteda and standards are valid is whether or not it is 
possible to compile evidence or ta for each. It is important that 
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criteria and standards' be determined first, and then evidence, because 
evidence alone appears to have little usefulness. 

The technique to be used for gathering evidence will depend uot only 
on the criteria and standards but also on the purpose or objectives of the 
evaluation program. A variety of ways of compiling cvid Mice was found 
in the- institutions studied. Tables 5, 6, and 7 in Section 1 show the 
evaluation techniques used by different types of institutions. Table 9 
gives a. summary of tRese sources and procedures according to the 
purposeof the evaluation program.* . > 



Table 9 

Sources and Selected Uses of Information for Faculty Evaluation, 



All Reporting ^Institutions 





Percentage of Respondents Reporting Utilization 


Source of 
Information 


Overall 

Use 


Vor Df»cisions 
on Salary 
Increases 


For Decisions 
on Promotion 
and Tenure 


For Faculty 
Improvement 


Aca domic Dean 

in V t' 




TO'T 


^ 81% 


.J 

81% 


Alumni 


IS 




A 


M 


Colleauuos 


\'y 


19 


29 


35 


Dt'partmcMit 
Ohairmaii 


' 90 




82 


83 


Kaculty 
Commiiioo 


39 


u 


33 


23 


/Joint Committee 
(faculty/studont) 


10 


2 


1 


7 


Pcc^rs ((Jtiior 
institutions) 


9 


1 


6 


\ 


Prr.sidt'nt or 
Provost 


17 


to 


n 


36 


S^lf-Kvaluation 


56 


25 


33 


51 


Studdits 


8S 


;jo 


.15 


79 



While those data shou ihv im[}or\iii}(v of various ovulence jiatlierinf^ 
techniques, they dp not shou lh(^ extent or use of the techniques for 
different evaluation areas and criteria. Allcr assessing this aspect of 
evaluation in the case study institutions, we have concluded that 
evidence, particularly as gathered in the area of instruction, is the 
element in current practues uhuh [H»rhaj2s requires greatest attention, " 
Criteria and evidence for sonu^ of thc^'other areas seem more (^itsily 



deyelpped and more readily accepted. Evidence related to criteriS'such 
as, humber of publications, number of citations, enrollment trends, 
number of advisees, and number of grants received, as the means for 
deterniining performance level is largely self-evident. Evidence of a 
more qualitative nature is more difficult to specify however. 

It seems most appropriate for each ,\^nstitution to decide for itself 
how best, to gather evidence in connection with the criteHa and 
standards that it has established. ^ • 

A variety of approaches to compiling evidence was found in the 
institutions studied. 



Self-evaluation. 

Table 9 shows that 56 percent of the institutions responding to the 
survey report use of self evaluation as an information gathering 
technique. Information from self-evaluations is used by 25 percent of 
the institutions for decisions on salary increases, by 33 percent* for - 
decisions on promotion and tenure, and by 51 peuent for faculty 
development and improvement The data show that while only slightly 
over half of the responding institutions use self-evaluation a!> a source of 
information at all, this technique is more likely tc^e used for faculty 
developrnent and improvement purposes than fQr purposes of personnel 
decisions* 

- It was found in the case studies that most self -evaluations usually are 
simply an annual listing or report of activities by each individual faculty 
member. In this report the faculty member may list publications, 
research projects, committee work, courses taught, numl^er of advisees, 
and other relevant information, usually jn a quantitative format. This 
technique .appears to be used primarily, therefore, as a means of 
providing quantitative data on faculty activity rather than as a 
technique for judging quality. 

On the other hand, m a few institutions studied, faculty members are 
asked to write a self-evaluation report reflecting on their year's work, 
sometimes usiiij; data from variou.s buurces employed by the institution. 
The value of such reflective self-evaluations has not been established. 
Centra (1977) found httle agreement between faculty self-evaluations 
of t<»aching effectiveness and ratings by students, colleagues, and 
administrators, lie found discrepancies most noial)ly in relation to 
student-teacher interaction, where about one-third of the instructors 
generally rated themselves considerably higher than did students. 

While self-evaluations may not be very reliable as sources of data for 
making personnel decisions, they may be more useful for development 
and improvement purposes. If faculty members are given non- 
threatening opportunities for self-reflection, the process might be more 
productiv^e. Examples of such self-reflection are found in institutions 
having fc»julty development offices at which faculty members may seek 
assistance without" the knowledge of administrative superiors. In sum, 



44 



self-evaluations.may be A legitimate technique for compiling some 
quantitative data on faculty activities, but the subjectivity of evaluative^ 
judgments must "be recogn/^ed? / 

Student ratings. ■ ' ^ " 

The sar\'ey results indicate widespread use'gf students as souices of 
information on faculty performance. Of the in.sUtutioiis^esponding to 
the survey questionnaire 88 percent report using info3jiiation from 
students aiid 30 ^perceiU of J;hose institutions us? vtljat student 
information for makiiig decisions on^saUlry increases, ^f^ percent for 
decisions on promotion . and ieauro, and 79 percent Tor faculty 
impTovement and development. The non-doctoral level institutions use 
student information more than doctoral level institutions, and two- 
year .institutions are more likely than any other institutional type to' 
use students as sources of information. 

^Unfortunately, while we know a number of institutions collect 
information frpm students, we do not know precisely how the 
information is used. The case study results Jndicate that a smaller 
percentage of institutions than that reported above use systematic 
student evaluation to provide comparative norms. A surprisingly large 
percentage of institutions evidently use students in such an informal 
way that the reliability, of informati'on gained is questionable. 

Among the institutions studied in depth, only one approaches 
student ratings systematically and on an instiaition-wide basis. At this 
institution, comparat ve norms and data are compiled, made available 
and used for suinmativo decision making/ln. the major doctoral level 
institutions studied, stutltMit ratings are loft to each department cr to 
each college. The most common piactur in such institutions sooms to 
be for each department to (lt\sign ' administer lUs own form and to 
use the results at the depart .ikmU.u level, primarily for summative 
purposes. Although tht^ survey found "dents most likely to be used as 
i;ources of miormalion u\ two-year mstitutions, few* of these 
institutions were found to use student ratings in a sy.stematic, 
institution-wide manner. ^ 

While the use of stud* nt ratings hits bocome widi»spread, ^uch ratmgs 
also have becoirie controversial. One probl. appears to be that many 
institutions tn^at studt^nt rating n^sults as if they were a comprc^hensive 
evaluation of instruction rather than one means of leathering (^vid(Mice 
with reqard to specific crilfna. Student ratings ei^rtainly do not provuU* 
all possible evidence tor all possiblt^ ( ritc^na \n the instructional area. In 
designing and using studt;nl rating forms, institutions may wish to keep 
in mmd that the only rvideinc one can obtam from students is that 
which they have. Students should not be ask(^d to provide .♦vider'H* 
regarding a criterion al)out which they are unlikely to have informatio.u 
The use of student (^valuation has cremated ihv woi\ for readily 
available and rc^liable forms. A number of organizations, incUiding 
Educational Testing ServK(\ Kansas State Tniversity. and l^urdue 
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University, market forms on a nationwide basis. Use of these forms 
allows institutions* the advantage of not having to design their own 
formsp-and they provide national norms and data for comparative 
purposes. 'On the other hand, many institutions feel there may be 
advantages to designing ' one's own instrument or at least adapting 
others, to suit one's own purposes,. 

There has been a. great deal of research into the validity of the data 
gained from student rating?, of which institutions should be aware.. 
Centra (1977) provides an exc€Uent summary of much of this research. 
He i:eported for example, that global questions which ask for an 
assessment of the overall effectiveness of the teacher and the, course 
correlate more highly with course examination results than do 
questioiis assessing more specific teachlng^ characteristics. He suggests 
that these global-typ^e questions may* be. valid estimates of students* 
'^caderaic achievement because such questions are not tied to a specific 
m^tructional style.. 

With regard to using studer' ratings for summative pifrposes, Centra 
offers this toncluding comment: 

If student ratings are used in making personnel decisions, 
there should be a sufficient and representative number of 
students responding for each class and the forms should be 
administered and collected in a prescribed and systematic 
manner. In addition, global or overall ratings rather than 
ratings of specific practices or behaviors ought to be. used, 
and ratines for several courses ovef a period of time .would 
probably provide the best basis for making judgments, (pp. 
98-99) 

Another approach to using student ratings is to survey students who 
have graduated. Many faculty ^eem to feci that judgment of alumni are 
more reliable than those of enrolled studonls. The research summarized 
by Centra sliows, however, that ratingi. by alumni who have been out of 
college for 5 to 10 years compare favorably to current students' ratings 
of the same instructors and courses. Some institutions find that alumni 
may be more appropriately used to provide, information on the 
usefulness of certain programs or courses as preparation for various 
.professions. , , ' 



Colleague ratings 

The sur\'ey results show that colleagues, either as individuals or -as 
members of faculty committees, an^ used in various ways as sources of 
evidence. Colleagues as individuals are reported used by \o percent of 
the re.4ponding institutions, and faculty committees by 39 percent. 
Respondents in 19 percent uf the mstftutions say they use individual 
colleagues as sources of evidence for decisions on salary increases, 29 
percent use them as sources for decisions on promotion »ind tenure, and 
35 percent for faculty devclopirent and improvement. Information 
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from faculty committees is used by only 14 percent of the insUtutions 
for' decisions on salary increases, by 33 percent for decisions on 
promotion and tenure, and by 23 percent for faculty development and 
improvement. 

Colleagues aiC most likely to be sources ^of information in doctoral 
level institutions and least likely in two-year ^^institutions. For 
summative purposes, 54 percent of the doctoral ievel'institutions report 
using., individual colleagues, and 37 percent report using faculty ^ 
committees as sources of evidence. Only 32 percent of Jhe two-year 
institutions use information from individuals, and only 17 percent use 
faculty committees. Colleagues probably are used more by doctoral 
level institutions to judge the quality o£ research and publications. The 
case study lesults suggest that if one looks at instruction aloi}e^ the use 
of colleagues as sources of evidence would be unusual in all institutions, 
and perhaps mosCunusual at the doctoral level. 

.Perhaps the least usrj and lea&t effective colleague ratings are those 
derived from classroom visits to observc^ teaching. Strong faculty 
resistance to visitation was found in the institutions included in ihv ca^e 
studies. Moreover, research at several institutions shows that colleague 
-ratings based primarily on observations of chissroom penformance are 
not sufficiently reliable for making personnel decisions. Centra,^ for 
example, found that such ratings are far less reliable than student 
ratings, probably because one s colleagues tend t, ave a positive bias. 

Colleague ratings of teaching materials, such": .^yllabi. reading lisUs 
and examinations, may be more valuable than those based on classroom 
visitations. .A numl)er.of mstitutions used colleagues in this way wMth 
positive results. In one instituti'^^n it was found that simply requirii>g 
colleague review of teaching materials caused them to begin to improve 

dramatically. " . *. e 

When one moves i**om summative lb formative evaluation, the use ol 
colleagues as sources of " information may be more useful. If an 
institution uses ccUeaj^iies in n^n mformal situation to provide positive 
feedback on^inst^-uction. the element of threat may largely disappear. If 
resistance is reduced, colleagues may be able to provide supportive 
suggestions and criticism of instructional practices. 

J 

Student Learnm On i comes. 

A number of writers H()s(» (197()) and Mec^th (197b), for 
exami.!e-contena that cr.terK)n-n^rerence(l measurement of learning is 
the ultimate standard of ^oo(l teaching and that data on the extent of 
learning; is the only legitimate (Widence for determining instructional 
effectiveness. How^^cr. lising evidence ol student learning is uncommon 
" in the iithcrn regio;> Because, this approach requires one to look at 
Student behavior rather than the behavior of th.- instructor, a great 
deabol resistance is^enerated. Faculty opj>osed tt) this lipproaeh argue 
that if their eflcctivencss is to he judged, it is their own behavior that 
Shouki be observed. The atyument for using student learning outcomes 
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as evidence is that student success should be the mam criterion for 
judging . teaching effectiveness. One cannot be judged an effective 
fteachef, it is argued, unless significant student learning can be 
identified. ^ " / 

This approach to gatneniicv evidence on instructional effectiveness is 
most liRely-^ to be found in Colleges or universities which have 
/Management by Objectives (MBO), behJlvioral or instructional 
Qbjectives, competency-based curricula, or a systems approach to 
jristfuction. Eyen few of those institutions use this technique, but they 
^ are the types jty \vhich it most likelj-^ would apply. In more traditional 
institutiohs this technique can be found in the performing arts and in 
Vpcationat and technical programs. Two major doctoral level 
insUlutr^ns visited us^ vhis approach exclusively in the performing arts, 
wiih eviden** success. ^ . ^ - 

dearly, measuring student learning outcomes emphasizes purpose 
and impact. One community college in the region is moving toward an 
institutipn-wide system of I'p^rformance contracting" in which faculty 
njembers "contract" with*the institution to produce ascertain student 
success rate. (5ften.a^ third party determines whether students hav^ met 
learning objectives. Pre- and post-tests of student achievement are used 
extens^ely. It is interesting to note that this college is deemphasjzing^ 
the use of studeht-evaluation-of-Tnstruction forms as legitimate 
measures of teaching e'^^ectiveness. Officials at this institution are 
asking students to judge only thpse things they can judge, such as the 
teacher's behavior^rather than their own learning growth. , 

It appears difficult to dispute the point' that student learning is th^ ' 
purpose of the instructional process. The problem with using student 
learning outcomes as^evidence of teaching effe^rtiveness is that such 
outcomes are not readily a\ailablt«tu hen traditional teaching approaches 
are usod. \vith newer approaches, such as individualized instruction, 
competency-based instruction, and contract learning, such outcomes 
should be more visible. 



Multiple Approaches, 

In summary, it seems clear that there are advantages .and 
disadvantages to all a])proaches for gathering evidence in the 
instructional aK\i. Because none of the approaches to gathering 
evidence appears to be entirely reliable, or most likely to achieve 
acceptance amon^ faculty, it probably best to make use of a variety 
jof approaches. Attention will be given in the next section to the issue 
o( strategy to be used in developinj^ an et^Ulualion program, butit may 
be^wc** to note here that x)ne of the weaknesses of current evaluation 
pra(j;J,ices is failure of faculty to 'accept the sources of evidence or 
proce,dures for gathering it. No matter how valid the technique may be, 
if it is institutive! in a \vay that causes fatuity resentment and resistance, 
the evidence gathered \v»il be suspea. Student ratings, for e.xaniple, are 
easily influenced [)y what is said during the process of their 
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administration. If a resistant, unhap|:> faculty is doing the 
administering, student responses stan'd to lose any possible validity. 



. Putting All The Elements Together 

The three elements which are common to evaluation programs- 
criteria, standards, md evidences-have been described. Figure 2 pro- _ 
vides a hypothetical example of how an evaluation elements chart 
i^ight look as an 'institiition begins the process of developing the 



P'Mt' 'V V V*' ^ ^ ""jExample of ah Evaluation Elenients Chart 



i; Student learhihg gains 



:i^:-Cdurfeiiaterials 



1:3, Student satisfaction 



Standards 



15%. achieve 90% of learnirig 
/objectives^ _ ; 



,Cleari relevant, current: 
bchavidral objectives. 



80% rate course in top level 



Pre: and FK)stHett^ I 

rbly" departm^^^ \ 1 



SubiniU'td'tS^a^^^ 
by depajf^en^^ 
st¥de^^^^ . . / ' , V \ 



S^dent ratings, . a.*- 



,l;-Publications 



Specific number in refereed 
journals 

Excellence in quality 



Faculty ielf-report 



Testimony of % puUjdr v 
reafdersi citations in other: :J 
works ^ I 



2. Grants 



$20,000 minimum in gtanU 



Faculty self-report; records}* 



evaluation elements. This chart showir^ust two areas instruction and 
research-rand.jcmild be expanded to include other areas. The evaiua 
tioD elements char^ may be developed art an institution-wide basis 
at smaller institutions, or on a divisional or departmental basis in larger 
institutions. As discussed previously, it also is possible to have individ- 
ualized evaluation plans Jor specific faculty members. 

It has been suggested that the most logical steps in developing these 
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three elements is to.i^egin with criteria for each evaluation area, then to 
* develop standards for each Criterion, and finally to assemble evidence 
for applying each standard |to. each criterion. One of the tests for 
validity in this process is tojaetermine whether or not it is possible to 
complete each succeeding^^tep. If Jt is not possible to agree upon 
standards for a given critendn, it may be that the criterion should not 
' be used. The same pointapplies to the form of evidence and techniques, 
for gathering it. ^ 

Procedures for Evaluating 



After the purpose of the evaluation program has been established, 
r^-' ' tf>e areas of faculty activity td be evaluated agreed upon, and the . 

/\ . ^ ' elements qf evaluation-^cnteria, standards, and evidence-developed, 
. / . ^ . . the, next sjbep4§. to establish a set of procedures to achieve the puipo 
^ . f» ^ " These proji^jdures^ are a Icey component in the evaluation p^o^am 
"fr -i: ' {because ifu^iothing; or little is done with all the^ ihaterial ^(>!t';^is 

' ... generated, then littlie can be expected to be accomplished. ^ ^ 

\A number of exemplary pat^tems of procedures were found p?th«^: 
cdse studies. It was pointed out in Section 1 that^^'one of ItHV*' 
; ; characteristics of current faculty evaluation practice is th^^it procedures, 

, summative and -formative, are dominated by administratt)t§^Table 10 
summarizes the survey results on this subject. . ^-^^ j 



/ . Table 10 

Ascignment of Princi^M Evaluation ResponsibHityioc Administrative 
Decisions an(^ for Pacvtlty Development^ Number of Institutions 



Source of Principal For Decisions on Salary, For Faculty 

■ Responsibility Promotion and Tenure Development 

AcadeniiC Dean or . . ^ 

Vice President - 190 i 167 

Department Chairman 155^ 167 

President or Provost o i^ 10 

.Facul* f Committee - 36 13 

Students * 10 , 67 

Colleagues ' 6 • * 0 

Self 2 21 

Peers (other institutions) • 2 2 

Jomt Student/ 

Faculty Group I 1 

.Alumni ,0 ^4 

Other 3 3 

No Response 77 72 



Total ' ' 536 536 
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• While there are a number of exceptions, it seems llyal many 
institutions use unsystematic and informal procedures in making 
evaluative judgments. Few insiitutioayifivolve the faculty at significant 
points in the evaluation prb^oss/Tlie absence of significant faculty 
involvement may be one explanation*' for the lack of evidence llRtl 

^current practices achieve the formative objettiv^s set for them. The case 
study results surest that in many non-doctoral level ins:itutions where 
due process and fair procedure i^suci* ^ire not vocalized, procedures for. 
making personnel decisions are -ague and will vary for different facult\ . 
For faculty development and improvement, prbcedures aVe even less 

^ well-defined and articulated throughout ail types of institutions. The 
dominant attitude seems to be that the fofmatne arer. is an individual 
responsibility, and that an institutional M»t of prcicedures or servu^es 
either is unnecessary or that no one knows what procedures would be 
appropriate. The remainder of this section provides a description of 
current approaches lo dt^veloping procedurrs in tlu* sumnialive and 
formative areas. c . ^ 

Sumniative Procedures. 

Procedures 'for making summali\i' judgments clearly are a necessity 
at all institutions. Ideally, sumnialive procedures .should fulfill the 
expectations and needs of both the institution and the incli\idual faeuMy 
member. The institution needs procedures (l)lhat will separate the 
superior, tWe satisfactory. 'and the unsatisfactory performei-s: (2) that 
will build an evaluation n^cord about each , faculty membeY to satisfy 
judicial and governiiKMital nMiuiremenls. (3) thai will provide' due 
process and fair procedures; (.Dthal will be acceptable to the total 
institutional community, including the faculty: and (5) that will 
allocate fairly and appropriately the suircc rewards the institution has 
available. The mdividuiil faculty member net^ds sumniative prr edures 
» that will, m addition to the abuv(», { 1 ) euMire that h(» or she is judge(l^)n 
the basis of his or her parlutdar resp()nsil)ilities; (2) provide clear, 
understandable, and i ommunicated criteria, standards, and^evidence; 
(8) prt)vid» 'for due process and an ajbpeal procedure: ( 1) involve* faculty 
in the d(?skgn and operation of the ph/gram.(5) ensure agamsl arbitrary 
?nd raprieious decisions: and* (0) provide fre(|ue:.i feedl)ack on 
perfornumce and expectations. 

The case studies show that then* are four km^s .of sumniative 
(decisions that can be iiilule about faiulty. I hey are decisions in vohing 
(1) promotion. (2.) tenure. (3) leriivnation. and (4) jncrit salary in- 
creases. Some institutions ha\e a multiple year contract system rather 
than tenure, but the procedures rema.n about the same. Of thcM four 
possible decisions, only/hat nnohing mer^^i salary increases normally 
occurs , annually, hisliiutions having ^yslenlatlc faculty evaluation 
programs often havr A separate procedure for making promotion and 
tenure decisions, and iuiother for merit salary increases. The <atter 
decisions can provide fatuliy with ronlnuious fe(»dback mid progress 
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reports, building a record that can be usid in promotion nnd tenure 
procedures later on. Termination can bo tile end result of the denial of 
promotion or tenure, or it may be Mndled through a separate 
pr^(dure» Typically, procedures for mak|ng promotion and tenure 
djffipisions are more elaborate than those for ahnual salary decisions,. 

/The first step in any procedure is cVmipiling the appropriate 
mformation into a .dos* ier for each ^Kutuy member. This process 
usually takes |ilaee within each department And is the responsibility of ' 
Either - the department chairman or a departmental committee. 'The 
dossier includes all evidence called for in tlie evaluation elements. In . 
addition, the candidate probably will liavei the i rivilege of adding 
radditiohal information. | 

Once the dossier is complete, the evaluation^ proc(^ss begins. Figures 3 
and 4 give two examples of procedural flow cl^arti currently being used 
at major doctoral level institutions in the SRpB xo^on. Both charts 
sho\v procedures for making decisions on promotion an^ tenure. 

Two principles are eviuent in the systems illustrated by these charts. 
JPirst, it is clear that both systems provide tor. multipV reviews anrf 
independent judgmeats regarding the same Jevidonce. Second, both 
provide significant faculty involvement in the'judgment prpcess. These 
principles seem to be effective in ensuring a high level of faculty 
satisfaction with the evaluation program and with the program results. 
In Figure 3, facuit., are involved primarily as members of **area 
advisor}' committees." Members of these committees, which exist in 
each of the. major areas of the institution, are appointed by the 
president^ from nominations made by the faculty senate. The 
committees review the same material reviewed by the adn.inistrators 
and make their own independent judgments. Faculty members also are 
sometimes part of this system at the departmental level, . and 
occasionally at the deanship level, when either tiie department 
chairman or the dean wishes outside consultation. 

Figure 1 shows that faculty are involved at the departmental, level, 
but primarily as members of ihv ^'University Committee onj'romotion 
and Tenure." This is a committee con.sisting of 21 tenured professoi-s, 
15 elected by the faculty and 9 appointed by the presid(»nt. It should 
hv of speciul ✓ iiiU'icsl ti> notr that thi.s comniittec .^its aoovc at! the 
administrative officials e,\cept the president. 

In both systems, one copy of the do.ssier go(».s through the entire 
procedure. At t»aih h^vej, jiulgment^s are made in wptten form and 
added to the dossier. Thus the dossier continues to build as it goes 
along and, at each) -step in *he procedure, the persons making 
recommendations see the recommendations that have^heen made at 
lower levels. Persons al the.se in.^titutions feel that these* pi^'-edures 
mandate greater objectivity and fairness than would a more informal 
approach. The institution using the pnnedures in Figure 1 follows a 
.system whereby each department and school has its own evaluation 
areas, criteria, standiu-dj;, and jt^virlenco. Cons(»quei»tl> , each of the 
components imist he a part of the dossiers and »MUst be carefully 
examined by the committees and administrative officers. 
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Smaller institutions would not have procedural flow cliarUs as 
elaborate as the two shown. The major difference in the smaller 
institutions is that there usually are not as many administrators. Even 
though «iis 'is the case, these insitutions st»ll could follow the two 
principles of multiple reviews of the same evidence and key 
involvement of faculty. Selection of faculty review committees could 
be made in sm^ll . institutions in a way ^anilar to that m large 
insitutions. 

. 'For annual performance review for merit salary increases, ins titutions 
typically use a less elaborate procedure than for promotion and tenure. 
The institution using the procedure in Figure 3, for example, follows a 
process that stops at the dean's level in making decisions for annual 
performance review. Separate copies of each department member's file 

—are provided the .department chairman and denn, who review the files 
independently and make separate judgments. Upon completion of these 
independent judgments, the departnu»nt chairman and the dean meet to 
compare judgments and to resolve differences. If a successful resolution 

• cannot be made, the dean's judgment is final. The vice president is part 
of the appeals procedure; Also, part of the i>ainual performance review 
is a mandatory conference between the department chairman and the 
faculty rpember. in which the faculty member is apprised of his or her 
standing and strong and weak poinUs. Faculty meml^ers without tenure 
are apprised of the progress they making toward tenure. 

AH the systems studied which have elaborate procedures include 
appeal processes. These pi"ocesses usuidly are limited, to (jucstions of 
proper procedure, rather than to substantive i.s.sues/ In public 
institutions, such appeal opportunities usually are required by law. 
Private institutions often feel pressure to follow due process procedures 

as well. , /\ 

A final issue regarding summative procedures is thai ol the upennt'ss 
of files and the availability of inft)rmatu)n and evaluation results to th<» 
individual faculty memi)er. Table 1 1 jiives resj^onses to a survu'y 
question regarding the availabihty of the results of evaluation to faculty 
members. , 

The meaning of the findings in Table 11 remains unclear, even 
though they may app(»ar straightforwartl. The reason for this lack of 
clarity is that respondents t ould either havt' understood the question to 
ask whether or not the final decision was t (.mmunieated to the fa(*ulty 
meml^er, or whether all information compiled in the decision making 
process Wcis made availai)le. If tht' former is the meaning understood, 
the high percentage of respondt'nts reporting affirmatively comes as ao.. 
surprise. If the latter v/as understood as lh(^ meaning of ih(» question, 
however, the high peretMitagt' of affirmative response.*^ is surprising 
indeed in light oi further .^^tudy. 

The case studies siiow that institutions re(iuinng all recommenda- 
tions and judgments be put in writing normally do not make the file 
contents completely avauable to the faculty memlxT concerned. 
Usually, instead, the faculty member is, provided a summary of what 
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Table 1 1 

Availability of Results of Kvtluatioii to Faculty Members 



? Type pf institution 

IJloctoral-^-^ 
;4Master*s 
I Sachelor*s 
Two- Year 



Number of Responding 
Iiistitutions 

70 
107 

150 , 
209 



Percentage Reporting 
Results Available 
loTaculty 

80% 

05 

98 



Total 



S36 



94 



\\a.s said, without InMn^' gi\t*n llu' nanu'.s (jf tin* persons makinjj each 
respoiiso. In somr casts, faculty nuMnln^rs are «ii\en aceess to tlie 
contents of the files with the names of the evaluatt^rs deleted. In no case 
where systematic evaluation practices are used are faculty entirely 
denied access to the sul)st<ini e o\' their nk\s. Persons interviewed in 
institutions seemed to f»'t 1 that openm*: files c(jmpleiely, inckuling 
association ^of the named evaluat(;rs with uh*it they said, would 
intimidate evaiuator^ and minimi/e fr<uikness m the evaluations. On tlu» 
other hand, some person^ feel that perM)ns nhtkin^^ ohjei ti\c evaluations 
sh(nild he willm^^ to make then jiiii^nu'nts known to those whom they 
are evaluating This issue, dearly, n a dilfu iilt one for institutions and 
may have to he dealt with t)n an nuiiMdiial hasis. 

There' Is no douht that tht elahorale summative procedures desi nhed 
here ccnistitute an enornioUs amount of v\ork. recjuin^ a ^reat amount 
of time, and sometimes prove huulensonie .t<) those mvolvecL Is this 
type of pro( edure worth it'^ Connutm^ |)oints (jf view were f(M;nd on 
this question m (Ihm ase ^i.iJies One vuf president for »icademii affairs 
who opposes elahorcite pr(nedures feels thai the burden is not vv(;rth 
die trouble and would prefer the mon m normal, less presMin^d 
atm<»sphrre w hu h t liar<i( tt ri/es institutions with infoimal eViiluation^ 
approaiht^. lie thinkv faiultv and administiatois should spmd their 
lime on ivorr important duties 

On lht» other haiui. most admnustralors and faculty at the two 
institutions Used .ls «'\am[)U^s iibo\e feel that the ad\ antailes of the 
elaboriit*' summati\e protedun* outweigh the <lisa(lvantaues. The 
follow m*^ are some ol the adViiiitiiue^ th<it wen* « itcd in the ( ase studies. 
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a. The critelria, standards and evidence needed for prqmotr6n, 
tenure and salary increases are known throughout the 
institution; because all know what is expectod of them, the 

- procedures stimulate rigor at lower levels. 

t 

b. Young, untenured professors seem to feel that the system 
provides the ^'potential for equity/' They feel protected 
by the 'elaborate procedures. They feel that it is nearly 
impossible for anyone to "get ' anyone else. . ' . 

.c. The^j-broad and significant faculty involvement in the 
sysf({m gives faculty members a feeling of coiitrol over 
their own destiny. 

d. The procedures provide for ''structured ci>nflict" in which 

people are encouraged to look for weaknesses, to criticize, 

and to find ways to do things better, 
< 

e. The procedures provide top admlni^arators the means to 
'*keep up" with what iS going on at all levels of the 
institution. By reading alUthose dossiers, administrators 
find out what departments are doing, whiit their plans.are, 
what weaknesses exist, and so on. It provides structured 
opportunities for administrators to meet w)th each other 
and communicate. 

f. The procedures are seen as a 1-ind of "checks and 
balances" sy.stem m that all institutfo.ial perspectives and 
constituencies are brought to bear O'l the same issue. 'I'op 
administrators then can balance &e various interests and 
points of view. Without the procedures, top administrators 
do not necessarily know what th(»se various and competing 

/ perspectives are. 

Finally, admini.stralors at in.stitutiuns UMng elaborate procedures for 
summaiive purposes express the \ie\\ point that these procedures have ' 
the effect of stimulating and assisting faculty development and 
improvement; in, short, a formative effec t to a summative process. Not 
only does the (juahty of th^^aoxurlfaculty improve (which is one 
approach to formative cvaliKitioiiV Mit simply going through the 
procedures causes faculty to do t\^('ir best. Knowing that what one does 
is being observed carefully at sevi^hil levels seems to have the effect of 
causing one to perform heller, in addition, these institutions find the 
elaborate procedure brings al)out a constant^ examination of the 
evaluation program' itself. INrsons at various evaluation levels 
continually nuesj-ipn the appropriateness of the evaluation areas, 
criteria, standards, and evidciKe available, and try to improve all the 
components. Fhc result is a continuall> changing 'rather than static 
evaluation program. 



57 

« - ' • 60 



Formative Procedures. 

It seems paradoxical that a majority of administratorb responding to 
the survey cited faculi^y develppment and improvement as the primary 
purpose of their faculty evaluation systems?4iiit that almost all existing 
procedures have been established to facilitate summative personnel 
decisions. There appear two chief reasons for the existence of so few 
examples of formative procedures. First, there is widespread reeling 
among administrators that faculty development and improvement is a 
personal and individual matter. It wil^ be recjilled that 36 percent of the 
respondents stated that simply providing faculty With information on 
their own teaching effectiveness was the primary purpose of their 
evaluation programs. Administrators at these institutions evidently feel 
this practice brings about improvement, although theicjs little evidence 
to support that supposition. 

The second reason for the lack of established formative procedures 
seems to be that there are few examples of what can be done and few 
new ideas are available. The two most successful approaches found are 
the establishment of campus faculty development centers or offices and 
the use of growth contracts: 

The work of campujy faculty development centers or offices in 
Southern colleges and universities has been described in detail elsewhere 
and need not be repeated here (Crow, Milton, Moomaw and O'Connell, 
1^76). -While these centers are directly concerned with providing 
assistance to faculty for development and improvement, tlu-y normally 
are not related to formal faculty evaluation programs. Instead they are 
available at the institution for thooe faculty who wish to receive such 
assistance. Directors of the.se centers say they do not want to become 
part of formal faculty evaluation because their services are best 
provided in a non-threatening atmosphere. It is hoped that faculty 
members, upon receiving the results of formal evaluation, go to the 
centers for the assistance they need. Unfortunately, that does not 
always .seem to he the case. Perhaps there is a failure on .some campases 
to communicate the services offered by campus centers. A procedure 
that would enceurage individual faculty i6 use the services of the 
centers when they find, as a result of the evaluation program, that such 
services are needed, would bo useful. Moreover, it would seem to be 
desirable to establish a direct link between evaluation and faculty 
development centers. An option that irr.^titutions might cow.sider is a 
requirement that persons achieving a certain level in the evaluation 
prograTi have an interview with a staff member of the faculty 
development center. The.se interviews could be confidential and not 
part of future evaluation. 

Perhaps the most successful formative procedu**es currently in use are 
those that come under the rubric of growth contracting. A growth 
contract focuses on each Indivulual faculty member, assisting each to 
a.s.sess hi, or her own work and to develop plans and tivitjes for^- 
changv and improvement. Formativt evaluation and the needs both of 
the individual and the institution are e!n[)hasi/ed. The individual 
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'faculty .nreml^. .plays a prominent role in deciding what Criteria, 
stoadards, evidence, and process are most appropriate and useful. 
EmphasisJs i^faced on a helping relationship rather than on s\immative • 
^decision making. 

In.the growth cdntract model, each individual works with a team of 
two or more persons who assist the faculty member m assessing 
st^ngths and ^weaknesses. Team members provide' supportive 
' observations ancThelpful criticism. Thrdi:ghout the process, emphasis is 
^^sitive an<f constructive. Institutions ushig this approach seemly to use 
^isi-formative evaluation system periodically for all faculty members 
and have a separate summative evaluation system that is used to^make 
.personnel decisions. In a growth contract institution the suniniativt^ 
evaluation is neither so intimidating nor so surphsing as it normally is 
because the faculty member is continuously involved in evaluation, 
assessment, growth and development. The individual is awafe of 
strengths and weaknesses and h«to been striving constantly to improve. 

At least one institution which uses the giowth contract approach Vsees 
it os providing a means of combining both summative andXo^mative 
♦evaluation procedures. Smith (1976) proposes that the grow ll^;cont]^/\ct 
should be used in this way. Smith and others inv(Mved uY^ faculty 
development activities .believe it is important that summative and 
formative procedures not be. separated. It was found in the case study 
interviews, however, that the -stress^ factor involved in summatiVo 
. evaluation is very strong and appears to interfere'substimtially with tl^o 
relationships that formative procedures reciuiro In addition to Smith, 
cited above, further dotaii on the use of growth contracts i.^ available m 
Mather (1975) and from Gordon ColU^ge (1977). 

ether formative ^procedures currently m use appear to be quite 
informal ih nature, sometimes no more than appointing a $>enior faculty 
member within a department to serve as a counselor to youi.^er faculty. 
When this is the case there usually is an attempt to se -^rate this 
practice from the summative evaluation process. Succe.s,. seems to 
depend greatly on the willingness of nulivulual faculty to make use of 
the available resource. 
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Section 3. 



Strategies for 
Implementing Faculty 
Evaluation Programs 



^ection 2 described a framework that he uhod for an.Jyzin*? 

or developing a systematic faculty evaluation progiam. Altbou^i 
faculty evaluation pro^nrams are hest when tailored tci suit the individual 
institution, it is the thesis of this report that there are common basic 
components which all evaluation programs should contain to be 
workable. The framework w'-hich contains four componenfe^ 
1) purposes, 2) evaluation areas, 3) evaluation elements, 4) procedures— 
can bCrAlsec} by ^ny type institution lo analyze its evaluation goals^^uul 
design a comprenensive approach that best fits \Us own circumstances, 
style and traditions. 

V^e have proposed that tiie m.jsl logical approacii to be used m 

- destigiring -a--fcK^1ty rvaiiialion program is to cU^Tlop the four 
components^in the sequential order in which they have been presented. 
While this order may not be essential in all cast we are certain that the 
first step should be a clear and straightforward statement of purpc;se 
and expected outcomes. This Ur>l step grealiy influences development 
of the remaining components and tae ultimate test of a successful 
faculty evaluation program is wiielher tiie program achieves, jLs 
purposes. The best planned faculty (;vakuiUun^M^tem TTa failure if the 
plan's object] ves_ara-not aciiirved.' 

— -\r\ addition to helping identify the essential coMiponeiui> and 
characteristics of current faeully e\aiuati(}ii practices, our mvt^stigations 
also yielded insigiUs into various tonditions and siralet'ies whuh seem 
to have an impact on the success of an evaluation program. 

L The institution might choose to organize the evaluation program 
around a central idea or specific program emphitsis. 

An analysis of the case sUidus i(>(l to liie ulenlification of several 
possible emphases winch a progivm might ihoose as its organi/jng 
focus. One such emphasis, successful in a number of major doctoral 
level institutions and polenluiiiy successful in other settings as well, is 
to develop complete pro^ edures first all. The concern for due procc^ss 
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^and^'fair pvocedure in these" institutions seems to be greater than 
concern for particular detail in criteria, tandards and evidence. 

Another set of in.stitutions has chosen tj focus on, a quantitative- 
mathematical approach, requiring quantification of key ^ro^;^pr" 
.components. This approach is recommended in some of the litgrmire 
and is practiced in a number of non-doctoral institutiprts where 
evaluation emphasizes the quantification of criteria, .standards, and 
evidence, and deen.phasizes thv? importance of elaborate procedures. 
Elaborate procedures are thought to be unnecessary because judgments 
are made by following a mathematical formula. This approach is said to 
offer the advantage of precise communication of expectations for 
rewards. It may be the best approach for institutions where a high 
degree of objectivity_and-specificityJs_valued. 

Placing primary emphasfs on student learning outcomes is an 
approach being considered by a few bachelor's level and two-year 
colleges in the region. This approach can most likely be used by 
institutions using instructional methodologies which call foreleg 
measurement of what students havx learned. Such measur^OTont TIppears 
to be most possible when there is individualized irtSfruction, a systems 
approach to instruction, a '^onipet<^ncy^ased curriculum, performance- 
based instructjori^nd tHehke. Using these measures for faculty 
evaluation may not be possible m more traditional institutions where 
-Expected student learning outcomes are not precisely stated or 
^examined. ' ^' 

A number of mstitutior.s emphasize MBO and use it as an organi/.ing 
rationale in developing their faculty evaluation programs. In this 
approach, written behavioral objectives are developed for both criteria 
and standards in the evaluation framework. 

2. Components and elements of a program should be designed to fit 
the individual institutional context. 

Institutions thinking of initiating lU'w programs sometimes try to 
gather all exi.^ting materials on similar institutional programs in order to 
adopt those that have been successful elsewhere. The case studies 
suggest, however, that while it is helpful to know how various practices 
work in uthei pldcts, succe.ss appeals tnosl likely wlien eac'n institution 
develops progi'am components for itself. Numerous evaluation forms 
that probably work very well in some circumstances are available for 
purchase on today's market. But it may be best not to start with the 
assumption that they will work in all circumstances. The very process 
of dei,ign\ng activities may be helpful in generating understanding and 
support among the various institutional constituencies. 

3. Program components ijnd practices should be kept open and well 
communicated throughout the institution. 

One of the reasons some faculty evaluation programs fail is the 
attempt to maintitm a degree of secrecy about certain program 
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components or elements. Keeping bet rct the names uf faculty members 

who serve on evaluation committees, for e.\.ample, seems to build 

distrust among faculty. One procedure might be to ha\e a facplty body 

choose the members of these committees and to publu i/e (he names of 

those chosen. It also seems best for the details oT th(» evaluation 

components and elements to be openly and dctnocratii all> arrived at, 

adopted, and publicircd throughout the institution. 
•I 

4. Willingness to be incremental and flexiblejnjdeveiojimg the prpgram 
and its components is important^___--— — ^ 

In developing^iew-^TSro^rams, institutions sometimes wait u itii 
componenis'^ndel^ are totally and completely devilupvd before 

Beginning any implementation. This practice can result m a long and 
tedious process, with implementation sometimes never taking place 
because all components and elements of a faculty evaluation program 
may never be perfectly developed to everyone's .satisfaction. The best 
strategy toTollovv, therefore, may be to start die program nurementally 
and maintain a flexible stance to\vard its further development and 
modification. 

5. It is important that top administrative support and commitment be 
assured. . . 

ifhe administration .should be committed not only to having an 
evaluation program, but also to doing what is necessary to make it 
work. There should be a willingness on the part of the administratu n to 
expend a large amount of effort, ^ive the faculty a significant voice in 
program development and operation and provide resources for the 
necessary evaluation compont^Us. 

6. The faculty needs to be iniinhitelv involved in program design and 
to play a significant role in program operation! 

There is no doubt that faculty evaluation programs and practn cs ( an 
be dictated from the top. but the ( a.se studies show i l('arl> that such 
dictation doe.s not prorlute workable progi'ams thai achieve the 
purposes set for them, insptntions operating systemrtic faculty 
evaluation programs have found that faculty are ca *)abl e of f i ! 1 1 ' ' a 
rcspon.sible role in evaluation. Moreover, fatuity are more likely to 
accept an evaluation pro^^ram and its rt»sult.s if they are signifu antiv 
involved in the process. 

?. 

7. Orientation or training for those to be involved in program 
operation^ will increase, the likelihood of a good beginning. 

Serious evaluation roles an* w\\ responsibilities for many 
admini.strators and faculty. Because so many are unprepared for these 
new roles, it may be desirable to include role descriptions as piirt of the 
program plan and to develop and londuct training sessions, ome the 
proper roles hav(» l)(»(»n determined and before the j>r()gram itself is 
implemented. 
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